2023-02-13 04:03:24,068 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-13 04:03:24,115 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=186, ProcessCount=168, AvailableMemoryMB=5211 2023-02-13 04:03:24,396 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a 2023-02-13 04:03:24,403 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 04:03:24,403 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/cluster_b88392a4-5917-dc8f-1e5a-bee1a286891a, deleteOnExit=true 2023-02-13 04:03:24,404 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 04:03:24,404 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/test.cache.data in system properties and HBase conf 2023-02-13 04:03:24,405 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 04:03:24,405 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/hadoop.log.dir in system properties and HBase conf 2023-02-13 04:03:24,406 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 04:03:24,406 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 04:03:24,406 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 04:03:24,507 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-13 04:03:24,861 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 04:03:24,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:03:24,865 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:03:24,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 04:03:24,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:03:24,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 04:03:24,866 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 04:03:24,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:03:24,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:03:24,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 04:03:24,867 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/nfs.dump.dir in system properties and HBase conf 2023-02-13 04:03:24,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/java.io.tmpdir in system properties and HBase conf 2023-02-13 04:03:24,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:03:24,868 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 04:03:24,869 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 04:03:25,366 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:03:25,371 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:03:25,651 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 04:03:25,795 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-13 04:03:25,807 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:25,846 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:25,879 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/java.io.tmpdir/Jetty_localhost_46625_hdfs____77tc69/webapp 2023-02-13 04:03:26,032 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46625 2023-02-13 04:03:26,044 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:03:26,045 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:03:26,577 WARN [Listener at localhost/33353] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:26,730 WARN [Listener at localhost/33353] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:03:26,758 WARN [Listener at localhost/33353] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:26,765 INFO [Listener at localhost/33353] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:26,770 INFO [Listener at localhost/33353] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/java.io.tmpdir/Jetty_localhost_35251_datanode____ms2efn/webapp 2023-02-13 04:03:26,892 INFO [Listener at localhost/33353] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35251 2023-02-13 04:03:27,312 WARN [Listener at localhost/39119] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:27,333 WARN [Listener at localhost/39119] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:03:27,340 WARN [Listener at localhost/39119] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:27,341 INFO [Listener at localhost/39119] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:27,353 INFO [Listener at localhost/39119] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/java.io.tmpdir/Jetty_localhost_40857_datanode____.58iibf/webapp 2023-02-13 04:03:27,467 INFO [Listener at localhost/39119] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40857 2023-02-13 04:03:27,478 WARN [Listener at localhost/42775] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:27,786 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc53a702e4437f1b9: Processing first storage report for DS-83229563-f63c-4e60-878a-9241a8ba826f from datanode 72da109b-e06c-4ed5-a7dd-c4cb158b7b55 2023-02-13 04:03:27,788 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc53a702e4437f1b9: from storage DS-83229563-f63c-4e60-878a-9241a8ba826f node DatanodeRegistration(127.0.0.1:32929, datanodeUuid=72da109b-e06c-4ed5-a7dd-c4cb158b7b55, infoPort=35221, infoSecurePort=0, ipcPort=42775, storageInfo=lv=-57;cid=testClusterID;nsid=842138713;c=1676261005440), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-13 04:03:27,788 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x269c4f68ca0a7972: Processing first storage report for DS-90dd9695-3f6c-4c44-b6bb-930dbd1e3327 from datanode 3ecdf8d0-8b01-4ce8-bed2-9e64874b5dfc 2023-02-13 04:03:27,788 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x269c4f68ca0a7972: from storage DS-90dd9695-3f6c-4c44-b6bb-930dbd1e3327 node DatanodeRegistration(127.0.0.1:37067, datanodeUuid=3ecdf8d0-8b01-4ce8-bed2-9e64874b5dfc, infoPort=46629, infoSecurePort=0, ipcPort=39119, storageInfo=lv=-57;cid=testClusterID;nsid=842138713;c=1676261005440), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:27,789 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x269c4f68ca0a7972: Processing first storage report for DS-0882df23-04f6-4510-ac37-8c941589adbe from datanode 3ecdf8d0-8b01-4ce8-bed2-9e64874b5dfc 2023-02-13 04:03:27,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x269c4f68ca0a7972: from storage DS-0882df23-04f6-4510-ac37-8c941589adbe node DatanodeRegistration(127.0.0.1:37067, datanodeUuid=3ecdf8d0-8b01-4ce8-bed2-9e64874b5dfc, infoPort=46629, infoSecurePort=0, ipcPort=39119, storageInfo=lv=-57;cid=testClusterID;nsid=842138713;c=1676261005440), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-13 04:03:27,789 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc53a702e4437f1b9: Processing first storage report for DS-d26a314e-9a9c-484e-b495-dee65117f8f7 from datanode 72da109b-e06c-4ed5-a7dd-c4cb158b7b55 2023-02-13 04:03:27,789 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc53a702e4437f1b9: from storage DS-d26a314e-9a9c-484e-b495-dee65117f8f7 node DatanodeRegistration(127.0.0.1:32929, datanodeUuid=72da109b-e06c-4ed5-a7dd-c4cb158b7b55, infoPort=35221, infoSecurePort=0, ipcPort=42775, storageInfo=lv=-57;cid=testClusterID;nsid=842138713;c=1676261005440), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:27,884 DEBUG [Listener at localhost/42775] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a 2023-02-13 04:03:27,968 INFO [Listener at localhost/42775] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/cluster_b88392a4-5917-dc8f-1e5a-bee1a286891a/zookeeper_0, clientPort=60256, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/cluster_b88392a4-5917-dc8f-1e5a-bee1a286891a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/cluster_b88392a4-5917-dc8f-1e5a-bee1a286891a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 04:03:27,986 INFO [Listener at localhost/42775] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60256 2023-02-13 04:03:27,995 INFO [Listener at localhost/42775] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:27,997 INFO [Listener at localhost/42775] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:28,689 INFO [Listener at localhost/42775] util.FSUtils(479): Created version file at hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756 with version=8 2023-02-13 04:03:28,689 INFO [Listener at localhost/42775] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:28,691 INFO [Listener at localhost/42775] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:28,694 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/hbase-staging 2023-02-13 04:03:29,051 INFO [Listener at localhost/42775] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-13 04:03:29,542 INFO [Listener at localhost/42775] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:29,574 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:29,575 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:29,575 INFO [Listener at localhost/42775] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:29,575 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:29,575 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:29,730 INFO [Listener at localhost/42775] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:29,803 DEBUG [Listener at localhost/42775] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-13 04:03:29,894 INFO [Listener at localhost/42775] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40081 2023-02-13 04:03:29,904 INFO [Listener at localhost/42775] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:29,906 INFO [Listener at localhost/42775] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:29,928 INFO [Listener at localhost/42775] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40081 connecting to ZooKeeper ensemble=127.0.0.1:60256 2023-02-13 04:03:29,972 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:400810x0, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:29,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40081-0x1004bd90c110000 connected 2023-02-13 04:03:30,005 DEBUG [Listener at localhost/42775] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:30,006 DEBUG [Listener at localhost/42775] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:30,010 DEBUG [Listener at localhost/42775] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:30,018 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40081 2023-02-13 04:03:30,018 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40081 2023-02-13 04:03:30,019 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40081 2023-02-13 04:03:30,019 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40081 2023-02-13 04:03:30,020 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40081 2023-02-13 04:03:30,026 INFO [Listener at localhost/42775] master.HMaster(439): hbase.rootdir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756, hbase.cluster.distributed=false 2023-02-13 04:03:30,096 INFO [Listener at localhost/42775] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:30,096 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:30,096 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:30,096 INFO [Listener at localhost/42775] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:30,096 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:30,097 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:30,101 INFO [Listener at localhost/42775] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:30,104 INFO [Listener at localhost/42775] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35817 2023-02-13 04:03:30,106 INFO [Listener at localhost/42775] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:03:30,113 DEBUG [Listener at localhost/42775] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:30,114 INFO [Listener at localhost/42775] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:30,116 INFO [Listener at localhost/42775] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:30,118 INFO [Listener at localhost/42775] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35817 connecting to ZooKeeper ensemble=127.0.0.1:60256 2023-02-13 04:03:30,123 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:358170x0, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:30,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35817-0x1004bd90c110001 connected 2023-02-13 04:03:30,124 DEBUG [Listener at localhost/42775] zookeeper.ZKUtil(164): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:30,125 DEBUG [Listener at localhost/42775] zookeeper.ZKUtil(164): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:30,126 DEBUG [Listener at localhost/42775] zookeeper.ZKUtil(164): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:30,127 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35817 2023-02-13 04:03:30,127 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35817 2023-02-13 04:03:30,128 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35817 2023-02-13 04:03:30,132 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35817 2023-02-13 04:03:30,132 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35817 2023-02-13 04:03:30,145 INFO [Listener at localhost/42775] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:30,145 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:30,145 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:30,145 INFO [Listener at localhost/42775] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:30,146 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:30,146 INFO [Listener at localhost/42775] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:30,146 INFO [Listener at localhost/42775] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:30,149 INFO [Listener at localhost/42775] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41187 2023-02-13 04:03:30,149 INFO [Listener at localhost/42775] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:03:30,151 DEBUG [Listener at localhost/42775] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:30,152 INFO [Listener at localhost/42775] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:30,154 INFO [Listener at localhost/42775] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:30,156 INFO [Listener at localhost/42775] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41187 connecting to ZooKeeper ensemble=127.0.0.1:60256 2023-02-13 04:03:30,163 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:411870x0, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:30,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41187-0x1004bd90c110002 connected 2023-02-13 04:03:30,164 DEBUG [Listener at localhost/42775] zookeeper.ZKUtil(164): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:30,165 DEBUG [Listener at localhost/42775] zookeeper.ZKUtil(164): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:30,166 DEBUG [Listener at localhost/42775] zookeeper.ZKUtil(164): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:30,166 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41187 2023-02-13 04:03:30,167 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41187 2023-02-13 04:03:30,168 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41187 2023-02-13 04:03:30,172 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41187 2023-02-13 04:03:30,172 DEBUG [Listener at localhost/42775] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41187 2023-02-13 04:03:30,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40081,1676261008871 2023-02-13 04:03:30,183 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:03:30,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40081,1676261008871 2023-02-13 04:03:30,205 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:30,205 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:30,205 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:30,206 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:30,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:03:30,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40081,1676261008871 from backup master directory 2023-02-13 04:03:30,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:03:30,211 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40081,1676261008871 2023-02-13 04:03:30,211 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:03:30,212 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:30,212 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40081,1676261008871 2023-02-13 04:03:30,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-13 04:03:30,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-13 04:03:30,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/hbase.id with ID: 20d7b89a-9184-42ed-b5b4-001a1fd43974 2023-02-13 04:03:30,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:30,353 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:30,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x30fa0357 to 127.0.0.1:60256 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:30,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e6d79fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:30,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:30,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 04:03:30,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-13 04:03:30,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-13 04:03:30,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 04:03:30,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 04:03:30,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:30,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/data/master/store-tmp 2023-02-13 04:03:30,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:30,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:03:30,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:30,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:30,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:03:30,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:30,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:30,571 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261010569Disabling compacts and flushes for region at 1676261010570 (+1 ms)Disabling writes for close at 1676261010570Writing region close event to WAL at 1676261010570Closed at 1676261010570 2023-02-13 04:03:30,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/WALs/jenkins-hbase4.apache.org,40081,1676261008871 2023-02-13 04:03:30,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40081%2C1676261008871, suffix=, logDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/WALs/jenkins-hbase4.apache.org,40081,1676261008871, archiveDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/oldWALs, maxLogs=10 2023-02-13 04:03:30,661 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37067,DS-90dd9695-3f6c-4c44-b6bb-930dbd1e3327,DISK] 2023-02-13 04:03:30,661 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32929,DS-83229563-f63c-4e60-878a-9241a8ba826f,DISK] 2023-02-13 04:03:30,670 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-13 04:03:30,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/WALs/jenkins-hbase4.apache.org,40081,1676261008871/jenkins-hbase4.apache.org%2C40081%2C1676261008871.1676261010605 2023-02-13 04:03:30,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32929,DS-83229563-f63c-4e60-878a-9241a8ba826f,DISK], DatanodeInfoWithStorage[127.0.0.1:37067,DS-90dd9695-3f6c-4c44-b6bb-930dbd1e3327,DISK]] 2023-02-13 04:03:30,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:30,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:30,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:30,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:30,812 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:30,819 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 04:03:30,852 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 04:03:30,864 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:30,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:30,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:30,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:30,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:30,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73584329, jitterRate=0.09649194777011871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:03:30,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676261010780Initializing all the Stores at 1676261010782 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261010783 (+1 ms)Cleaning up temporary data from old regions at 1676261010877 (+94 ms)Cleaning up detritus from prior splits at 1676261010878 (+1 ms)Region opened successfully at 1676261010894 (+16 ms) 2023-02-13 04:03:30,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 04:03:30,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 04:03:30,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 04:03:30,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 04:03:30,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 04:03:30,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-02-13 04:03:30,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 04:03:30,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 04:03:30,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 04:03:31,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 04:03:31,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 04:03:31,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 04:03:31,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 04:03:31,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 04:03:31,041 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:31,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 04:03:31,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 04:03:31,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 04:03:31,060 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:31,060 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:31,060 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:31,060 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:31,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40081,1676261008871, sessionid=0x1004bd90c110000, setting cluster-up flag (Was=false) 2023-02-13 04:03:31,079 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:31,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 04:03:31,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40081,1676261008871 2023-02-13 04:03:31,092 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:31,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 04:03:31,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40081,1676261008871 2023-02-13 04:03:31,102 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.hbase-snapshot/.tmp 2023-02-13 04:03:31,177 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(952): ClusterId : 20d7b89a-9184-42ed-b5b4-001a1fd43974 2023-02-13 04:03:31,177 INFO [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(952): ClusterId : 20d7b89a-9184-42ed-b5b4-001a1fd43974 2023-02-13 04:03:31,186 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:03:31,186 DEBUG [RS:1;jenkins-hbase4:41187] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:03:31,193 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:03:31,193 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:03:31,193 DEBUG [RS:1;jenkins-hbase4:41187] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:03:31,193 DEBUG [RS:1;jenkins-hbase4:41187] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:03:31,200 DEBUG [RS:1;jenkins-hbase4:41187] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:03:31,200 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:03:31,202 DEBUG [RS:1;jenkins-hbase4:41187] zookeeper.ReadOnlyZKClient(139): Connect 0x7c8ef22b to 127.0.0.1:60256 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:31,202 DEBUG [RS:0;jenkins-hbase4:35817] zookeeper.ReadOnlyZKClient(139): Connect 0x3e5751fe to 127.0.0.1:60256 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:31,211 DEBUG [RS:1;jenkins-hbase4:41187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dd7039a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:31,211 DEBUG [RS:0;jenkins-hbase4:35817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@576a0583, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:31,212 DEBUG [RS:1;jenkins-hbase4:41187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@599ed194, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:31,212 DEBUG [RS:0;jenkins-hbase4:35817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d07cbe4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:31,239 DEBUG [RS:1;jenkins-hbase4:41187] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41187 2023-02-13 04:03:31,242 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35817 2023-02-13 04:03:31,244 INFO [RS:1;jenkins-hbase4:41187] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:03:31,244 INFO [RS:1;jenkins-hbase4:41187] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:03:31,244 INFO [RS:0;jenkins-hbase4:35817] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:03:31,244 INFO [RS:0;jenkins-hbase4:35817] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:03:31,244 DEBUG [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:03:31,245 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:03:31,248 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40081,1676261008871 with isa=jenkins-hbase4.apache.org/172.31.14.131:35817, startcode=1676261010095 2023-02-13 04:03:31,248 INFO [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40081,1676261008871 with isa=jenkins-hbase4.apache.org/172.31.14.131:41187, startcode=1676261010144 2023-02-13 04:03:31,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:31,268 DEBUG [RS:1;jenkins-hbase4:41187] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:03:31,268 DEBUG [RS:0;jenkins-hbase4:35817] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:03:31,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:31,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:31,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:31,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:31,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 04:03:31,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:31,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676261041272 2023-02-13 04:03:31,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 04:03:31,277 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:31,277 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 04:03:31,283 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:31,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 04:03:31,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 04:03:31,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 04:03:31,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 04:03:31,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 04:03:31,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 04:03:31,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 04:03:31,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 04:03:31,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 04:03:31,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 04:03:31,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261011307,5,FailOnTimeoutGroup] 2023-02-13 04:03:31,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261011307,5,FailOnTimeoutGroup] 2023-02-13 04:03:31,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 04:03:31,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,328 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:31,330 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:31,330 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756 2023-02-13 04:03:31,337 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41699, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:03:31,337 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51755, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:03:31,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:31,360 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40081] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:31,371 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:31,375 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:03:31,378 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756 2023-02-13 04:03:31,379 DEBUG [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756 2023-02-13 04:03:31,379 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33353 2023-02-13 04:03:31,379 DEBUG [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33353 2023-02-13 04:03:31,379 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:03:31,379 DEBUG [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:03:31,380 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/info 2023-02-13 04:03:31,382 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:03:31,383 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:31,383 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:03:31,386 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:31,387 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:03:31,387 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:31,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:03:31,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/table 2023-02-13 04:03:31,390 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:03:31,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:31,393 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740 2023-02-13 04:03:31,394 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740 2023-02-13 04:03:31,398 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:03:31,398 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:31,399 DEBUG [RS:0;jenkins-hbase4:35817] zookeeper.ZKUtil(162): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:31,399 DEBUG [RS:1;jenkins-hbase4:41187] zookeeper.ZKUtil(162): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:31,399 WARN [RS:0;jenkins-hbase4:35817] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:31,400 WARN [RS:1;jenkins-hbase4:41187] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:31,401 INFO [RS:1;jenkins-hbase4:41187] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:31,401 DEBUG [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/WALs/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:31,401 INFO [RS:0;jenkins-hbase4:35817] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:31,402 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/WALs/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:31,402 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:03:31,404 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41187,1676261010144] 2023-02-13 04:03:31,404 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35817,1676261010095] 2023-02-13 04:03:31,409 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:31,410 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59497550, jitterRate=-0.11341741681098938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:03:31,410 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676261011371Initializing all the Stores at 1676261011374 (+3 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261011374Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261011374Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261011375 (+1 ms)Cleaning up temporary data from old regions at 1676261011396 (+21 ms)Cleaning up detritus from prior splits at 1676261011397 (+1 ms)Region opened successfully at 1676261011410 (+13 ms) 2023-02-13 04:03:31,410 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:03:31,411 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:03:31,411 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:03:31,411 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:03:31,411 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:03:31,412 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:03:31,412 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261011410Disabling compacts and flushes for region at 1676261011410Disabling writes for close at 1676261011411 (+1 ms)Writing region close event to WAL at 1676261011412 (+1 ms)Closed at 1676261011412 2023-02-13 04:03:31,414 DEBUG [RS:0;jenkins-hbase4:35817] zookeeper.ZKUtil(162): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:31,414 DEBUG [RS:1;jenkins-hbase4:41187] zookeeper.ZKUtil(162): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:31,415 DEBUG [RS:0;jenkins-hbase4:35817] zookeeper.ZKUtil(162): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:31,416 DEBUG [RS:1;jenkins-hbase4:41187] zookeeper.ZKUtil(162): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:31,419 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:31,419 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 04:03:31,427 DEBUG [RS:1;jenkins-hbase4:41187] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:03:31,427 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:03:31,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 04:03:31,437 INFO [RS:1;jenkins-hbase4:41187] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:03:31,437 INFO [RS:0;jenkins-hbase4:35817] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:03:31,442 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 04:03:31,444 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 04:03:31,459 INFO [RS:0;jenkins-hbase4:35817] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:03:31,459 INFO [RS:1;jenkins-hbase4:41187] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:03:31,463 INFO [RS:1;jenkins-hbase4:41187] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:03:31,463 INFO [RS:0;jenkins-hbase4:35817] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:03:31,464 INFO [RS:1;jenkins-hbase4:41187] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,464 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,465 INFO [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:03:31,465 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:03:31,474 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,474 INFO [RS:1;jenkins-hbase4:41187] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,474 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,474 DEBUG [RS:1;jenkins-hbase4:41187] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,475 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,475 DEBUG [RS:1;jenkins-hbase4:41187] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,475 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,475 DEBUG [RS:1;jenkins-hbase4:41187] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,475 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,475 DEBUG [RS:1;jenkins-hbase4:41187] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,475 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,475 DEBUG [RS:1;jenkins-hbase4:41187] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,475 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:31,475 DEBUG [RS:1;jenkins-hbase4:41187] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:31,475 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,476 DEBUG [RS:1;jenkins-hbase4:41187] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,476 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,476 DEBUG [RS:1;jenkins-hbase4:41187] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,476 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,476 DEBUG [RS:1;jenkins-hbase4:41187] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,476 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,476 DEBUG [RS:1;jenkins-hbase4:41187] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:31,479 INFO [RS:1;jenkins-hbase4:41187] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,479 INFO [RS:1;jenkins-hbase4:41187] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,479 INFO [RS:1;jenkins-hbase4:41187] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,479 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,479 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,479 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,496 INFO [RS:1;jenkins-hbase4:41187] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:03:31,496 INFO [RS:0;jenkins-hbase4:35817] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:03:31,499 INFO [RS:1;jenkins-hbase4:41187] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41187,1676261010144-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,499 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35817,1676261010095-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:31,521 INFO [RS:0;jenkins-hbase4:35817] regionserver.Replication(203): jenkins-hbase4.apache.org,35817,1676261010095 started 2023-02-13 04:03:31,521 INFO [RS:1;jenkins-hbase4:41187] regionserver.Replication(203): jenkins-hbase4.apache.org,41187,1676261010144 started 2023-02-13 04:03:31,522 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35817,1676261010095, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35817, sessionid=0x1004bd90c110001 2023-02-13 04:03:31,522 INFO [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41187,1676261010144, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41187, sessionid=0x1004bd90c110002 2023-02-13 04:03:31,522 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:03:31,522 DEBUG [RS:1;jenkins-hbase4:41187] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:03:31,522 DEBUG [RS:0;jenkins-hbase4:35817] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:31,522 DEBUG [RS:1;jenkins-hbase4:41187] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:31,523 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35817,1676261010095' 2023-02-13 04:03:31,523 DEBUG [RS:1;jenkins-hbase4:41187] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41187,1676261010144' 2023-02-13 04:03:31,523 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:31,523 DEBUG [RS:1;jenkins-hbase4:41187] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:31,524 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:31,524 DEBUG [RS:1;jenkins-hbase4:41187] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:31,525 DEBUG [RS:1;jenkins-hbase4:41187] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:03:31,525 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:03:31,525 DEBUG [RS:1;jenkins-hbase4:41187] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:03:31,525 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:03:31,525 DEBUG [RS:1;jenkins-hbase4:41187] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:31,525 DEBUG [RS:0;jenkins-hbase4:35817] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:31,526 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35817,1676261010095' 2023-02-13 04:03:31,526 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:31,526 DEBUG [RS:1;jenkins-hbase4:41187] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41187,1676261010144' 2023-02-13 04:03:31,526 DEBUG [RS:1;jenkins-hbase4:41187] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:31,527 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:31,527 DEBUG [RS:1;jenkins-hbase4:41187] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:31,527 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:03:31,527 DEBUG [RS:1;jenkins-hbase4:41187] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:03:31,528 INFO [RS:0;jenkins-hbase4:35817] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:03:31,528 INFO [RS:1;jenkins-hbase4:41187] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:03:31,528 INFO [RS:0;jenkins-hbase4:35817] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:03:31,528 INFO [RS:1;jenkins-hbase4:41187] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:03:31,597 DEBUG [jenkins-hbase4:40081] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 04:03:31,601 DEBUG [jenkins-hbase4:40081] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:31,608 DEBUG [jenkins-hbase4:40081] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:31,608 DEBUG [jenkins-hbase4:40081] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:31,608 DEBUG [jenkins-hbase4:40081] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:31,611 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41187,1676261010144, state=OPENING 2023-02-13 04:03:31,619 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 04:03:31,620 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:31,621 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:03:31,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:31,811 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:31,813 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:03:31,816 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49924, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:03:31,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 04:03:31,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:31,833 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41187%2C1676261010144.meta, suffix=.meta, logDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/WALs/jenkins-hbase4.apache.org,41187,1676261010144, archiveDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/oldWALs, maxLogs=32 2023-02-13 04:03:31,854 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37067,DS-90dd9695-3f6c-4c44-b6bb-930dbd1e3327,DISK] 2023-02-13 04:03:31,854 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32929,DS-83229563-f63c-4e60-878a-9241a8ba826f,DISK] 2023-02-13 04:03:31,858 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/WALs/jenkins-hbase4.apache.org,41187,1676261010144/jenkins-hbase4.apache.org%2C41187%2C1676261010144.meta.1676261011835.meta 2023-02-13 04:03:31,858 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37067,DS-90dd9695-3f6c-4c44-b6bb-930dbd1e3327,DISK], DatanodeInfoWithStorage[127.0.0.1:32929,DS-83229563-f63c-4e60-878a-9241a8ba826f,DISK]] 2023-02-13 04:03:31,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:31,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 04:03:31,877 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 04:03:31,883 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 04:03:31,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 04:03:31,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:31,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 04:03:31,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 04:03:31,891 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:03:31,893 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/info 2023-02-13 04:03:31,893 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/info 2023-02-13 04:03:31,894 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:03:31,895 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:31,895 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:03:31,897 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:31,897 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:31,897 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:03:31,898 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:31,898 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:03:31,900 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/table 2023-02-13 04:03:31,900 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/table 2023-02-13 04:03:31,900 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:03:31,901 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:31,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740 2023-02-13 04:03:31,906 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740 2023-02-13 04:03:31,911 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:03:31,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:03:31,916 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59422890, jitterRate=-0.11452993750572205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:03:31,916 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676261011889Writing region info on filesystem at 1676261011889Initializing all the Stores at 1676261011891 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261011891Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261011891Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261011891Cleaning up temporary data from old regions at 1676261011908 (+17 ms)Cleaning up detritus from prior splits at 1676261011909 (+1 ms)Running coprocessor post-open hooks at 1676261011916 (+7 ms)Region opened successfully at 1676261011916 2023-02-13 04:03:31,930 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676261011802 2023-02-13 04:03:31,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 04:03:31,953 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 04:03:31,954 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41187,1676261010144, state=OPEN 2023-02-13 04:03:31,957 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 04:03:31,958 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:03:31,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 04:03:31,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41187,1676261010144 in 334 msec 2023-02-13 04:03:31,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 04:03:31,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 534 msec 2023-02-13 04:03:31,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 815 msec 2023-02-13 04:03:31,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676261010201, completionTime=-1 2023-02-13 04:03:31,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 04:03:31,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 04:03:32,041 DEBUG [hconnection-0x3c0f588e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:32,044 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49934, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:32,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 04:03:32,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676261072063 2023-02-13 04:03:32,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676261132063 2023-02-13 04:03:32,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 88 msec 2023-02-13 04:03:32,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40081,1676261008871-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:32,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40081,1676261008871-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:32,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40081,1676261008871-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:32,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40081, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:32,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:32,097 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 04:03:32,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 04:03:32,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:32,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 04:03:32,120 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:03:32,124 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:03:32,146 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:32,149 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a empty. 2023-02-13 04:03:32,150 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:32,150 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 04:03:32,183 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:32,185 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 46bf8d61def62d889aa08263fb36be6a, NAME => 'hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:32,200 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:32,201 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 46bf8d61def62d889aa08263fb36be6a, disabling compactions & flushes 2023-02-13 04:03:32,201 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:32,201 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:32,201 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. after waiting 0 ms 2023-02-13 04:03:32,201 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:32,201 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:32,201 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 46bf8d61def62d889aa08263fb36be6a: Waiting for close lock at 1676261012201Disabling compacts and flushes for region at 1676261012201Disabling writes for close at 1676261012201Writing region close event to WAL at 1676261012201Closed at 1676261012201 2023-02-13 04:03:32,206 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:03:32,227 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261012210"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261012210"}]},"ts":"1676261012210"} 2023-02-13 04:03:32,261 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:03:32,264 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:03:32,269 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261012264"}]},"ts":"1676261012264"} 2023-02-13 04:03:32,275 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 04:03:32,279 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:32,281 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:32,281 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:32,281 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:32,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=46bf8d61def62d889aa08263fb36be6a, ASSIGN}] 2023-02-13 04:03:32,288 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=46bf8d61def62d889aa08263fb36be6a, ASSIGN 2023-02-13 04:03:32,291 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=46bf8d61def62d889aa08263fb36be6a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1676261010095; forceNewPlan=false, retain=false 2023-02-13 04:03:32,444 INFO [jenkins-hbase4:40081] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:03:32,446 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=46bf8d61def62d889aa08263fb36be6a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:32,446 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261012445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261012445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261012445"}]},"ts":"1676261012445"} 2023-02-13 04:03:32,451 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 46bf8d61def62d889aa08263fb36be6a, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:32,543 INFO [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35817%2C1676261010095, suffix=, logDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/WALs/jenkins-hbase4.apache.org,35817,1676261010095, archiveDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/oldWALs, maxLogs=32 2023-02-13 04:03:32,544 INFO [RS:1;jenkins-hbase4:41187] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41187%2C1676261010144, suffix=, logDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/WALs/jenkins-hbase4.apache.org,41187,1676261010144, archiveDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/oldWALs, maxLogs=32 2023-02-13 04:03:32,562 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32929,DS-83229563-f63c-4e60-878a-9241a8ba826f,DISK] 2023-02-13 04:03:32,563 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37067,DS-90dd9695-3f6c-4c44-b6bb-930dbd1e3327,DISK] 2023-02-13 04:03:32,568 INFO [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/WALs/jenkins-hbase4.apache.org,35817,1676261010095/jenkins-hbase4.apache.org%2C35817%2C1676261010095.1676261012545 2023-02-13 04:03:32,571 DEBUG [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32929,DS-83229563-f63c-4e60-878a-9241a8ba826f,DISK], DatanodeInfoWithStorage[127.0.0.1:37067,DS-90dd9695-3f6c-4c44-b6bb-930dbd1e3327,DISK]] 2023-02-13 04:03:32,572 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32929,DS-83229563-f63c-4e60-878a-9241a8ba826f,DISK] 2023-02-13 04:03:32,572 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37067,DS-90dd9695-3f6c-4c44-b6bb-930dbd1e3327,DISK] 2023-02-13 04:03:32,576 INFO [RS:1;jenkins-hbase4:41187] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/WALs/jenkins-hbase4.apache.org,41187,1676261010144/jenkins-hbase4.apache.org%2C41187%2C1676261010144.1676261012546 2023-02-13 04:03:32,577 DEBUG [RS:1;jenkins-hbase4:41187] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37067,DS-90dd9695-3f6c-4c44-b6bb-930dbd1e3327,DISK], DatanodeInfoWithStorage[127.0.0.1:32929,DS-83229563-f63c-4e60-878a-9241a8ba826f,DISK]] 2023-02-13 04:03:32,605 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:32,605 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:03:32,608 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:03:32,613 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:32,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 46bf8d61def62d889aa08263fb36be6a, NAME => 'hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:32,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:32,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:32,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:32,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:32,617 INFO [StoreOpener-46bf8d61def62d889aa08263fb36be6a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:32,619 DEBUG [StoreOpener-46bf8d61def62d889aa08263fb36be6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a/info 2023-02-13 04:03:32,619 DEBUG [StoreOpener-46bf8d61def62d889aa08263fb36be6a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a/info 2023-02-13 04:03:32,620 INFO [StoreOpener-46bf8d61def62d889aa08263fb36be6a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46bf8d61def62d889aa08263fb36be6a columnFamilyName info 2023-02-13 04:03:32,621 INFO [StoreOpener-46bf8d61def62d889aa08263fb36be6a-1] regionserver.HStore(310): Store=46bf8d61def62d889aa08263fb36be6a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:32,622 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:32,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:32,627 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:32,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:32,631 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 46bf8d61def62d889aa08263fb36be6a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66432256, jitterRate=-0.010082244873046875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:03:32,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 46bf8d61def62d889aa08263fb36be6a: Running coprocessor pre-open hook at 1676261012615Writing region info on filesystem at 1676261012615Initializing all the Stores at 1676261012617 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261012617Cleaning up temporary data from old regions at 1676261012624 (+7 ms)Cleaning up detritus from prior splits at 1676261012625 (+1 ms)Running coprocessor post-open hooks at 1676261012632 (+7 ms)Region opened successfully at 1676261012632 2023-02-13 04:03:32,633 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a., pid=6, masterSystemTime=1676261012605 2023-02-13 04:03:32,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:32,639 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:32,640 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=46bf8d61def62d889aa08263fb36be6a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:32,641 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261012640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261012640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261012640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261012640"}]},"ts":"1676261012640"} 2023-02-13 04:03:32,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 04:03:32,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 46bf8d61def62d889aa08263fb36be6a, server=jenkins-hbase4.apache.org,35817,1676261010095 in 195 msec 2023-02-13 04:03:32,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 04:03:32,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=46bf8d61def62d889aa08263fb36be6a, ASSIGN in 364 msec 2023-02-13 04:03:32,655 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:03:32,655 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261012655"}]},"ts":"1676261012655"} 2023-02-13 04:03:32,659 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 04:03:32,663 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:03:32,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 555 msec 2023-02-13 04:03:32,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 04:03:32,722 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:32,722 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:32,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:32,748 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43452, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:32,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 04:03:32,786 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:32,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-02-13 04:03:32,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 04:03:32,808 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:32,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-13 04:03:32,822 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 04:03:32,825 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 04:03:32,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.613sec 2023-02-13 04:03:32,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 04:03:32,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 04:03:32,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 04:03:32,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40081,1676261008871-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 04:03:32,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40081,1676261008871-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 04:03:32,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 04:03:32,883 DEBUG [Listener at localhost/42775] zookeeper.ReadOnlyZKClient(139): Connect 0x2b8795d6 to 127.0.0.1:60256 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:32,888 DEBUG [Listener at localhost/42775] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5317f3c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:32,947 DEBUG [hconnection-0x79d91649-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:32,959 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49936, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:32,970 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40081,1676261008871 2023-02-13 04:03:32,970 DEBUG [Listener at localhost/42775] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 04:03:32,980 DEBUG [Listener at localhost/42775] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:03:32,983 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:03:32,988 INFO [Listener at localhost/42775] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 04:03:32,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 04:03:32,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 04:03:32,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:53304 deadline: 1676261072992, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 04:03:33,011 INFO [Listener at localhost/42775] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 04:03:33,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:33,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 04:03:33,028 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:03:33,031 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:03:33,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 04:03:33,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:33,054 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:33,054 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:33,054 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:33,054 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:33,054 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:33,055 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:33,054 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:33,055 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:33,056 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61 empty. 2023-02-13 04:03:33,056 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459 empty. 2023-02-13 04:03:33,056 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4 empty. 2023-02-13 04:03:33,056 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292 empty. 2023-02-13 04:03:33,057 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5 empty. 2023-02-13 04:03:33,057 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f empty. 2023-02-13 04:03:33,057 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4 empty. 2023-02-13 04:03:33,057 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815 empty. 2023-02-13 04:03:33,059 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:33,059 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:33,059 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:33,059 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:33,059 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:33,059 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:33,059 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:33,059 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144 empty. 2023-02-13 04:03:33,059 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:33,060 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:33,060 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:33,060 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:33,060 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e empty. 2023-02-13 04:03:33,061 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:33,061 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 04:03:33,081 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:33,083 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e6ef3bb677a3d00689bba717531bd7f4, NAME => 'testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:33,084 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5015f186b2add7597cdf44bd360bc815, NAME => 'testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:33,084 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e908bf8c87ab34e33cb35ccd524fbb61, NAME => 'testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:33,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:33,168 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:33,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e908bf8c87ab34e33cb35ccd524fbb61, disabling compactions & flushes 2023-02-13 04:03:33,169 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:33,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:33,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. after waiting 0 ms 2023-02-13 04:03:33,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:33,169 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:33,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e908bf8c87ab34e33cb35ccd524fbb61: Waiting for close lock at 1676261013169Disabling compacts and flushes for region at 1676261013169Disabling writes for close at 1676261013169Writing region close event to WAL at 1676261013169Closed at 1676261013169 2023-02-13 04:03:33,169 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:33,170 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e6ef3bb677a3d00689bba717531bd7f4, disabling compactions & flushes 2023-02-13 04:03:33,170 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4eb1de542dca16f0a37b4785daf70ae5, NAME => 'testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:33,170 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:33,170 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:33,170 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:33,170 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. after waiting 0 ms 2023-02-13 04:03:33,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 5015f186b2add7597cdf44bd360bc815, disabling compactions & flushes 2023-02-13 04:03:33,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:33,171 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:33,171 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:33,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:33,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e6ef3bb677a3d00689bba717531bd7f4: Waiting for close lock at 1676261013170Disabling compacts and flushes for region at 1676261013170Disabling writes for close at 1676261013171 (+1 ms)Writing region close event to WAL at 1676261013171Closed at 1676261013171 2023-02-13 04:03:33,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. after waiting 0 ms 2023-02-13 04:03:33,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:33,171 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:33,171 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 5015f186b2add7597cdf44bd360bc815: Waiting for close lock at 1676261013171Disabling compacts and flushes for region at 1676261013171Disabling writes for close at 1676261013171Writing region close event to WAL at 1676261013171Closed at 1676261013171 2023-02-13 04:03:33,172 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => cb9464752b5ad5b19e32ab69fb72a292, NAME => 'testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:33,172 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ef40a30f4f57b6d0b3597de97041a459, NAME => 'testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:33,193 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:33,195 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4eb1de542dca16f0a37b4785daf70ae5, disabling compactions & flushes 2023-02-13 04:03:33,196 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:33,197 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:33,198 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. after waiting 0 ms 2023-02-13 04:03:33,198 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:33,198 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:33,198 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4eb1de542dca16f0a37b4785daf70ae5: Waiting for close lock at 1676261013195Disabling compacts and flushes for region at 1676261013195Disabling writes for close at 1676261013198 (+3 ms)Writing region close event to WAL at 1676261013198Closed at 1676261013198 2023-02-13 04:03:33,199 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => cd276396ab5ce2b0b9332f4d4be9f49f, NAME => 'testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:33,202 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:33,203 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing cb9464752b5ad5b19e32ab69fb72a292, disabling compactions & flushes 2023-02-13 04:03:33,203 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:33,203 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:33,203 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. after waiting 0 ms 2023-02-13 04:03:33,203 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:33,203 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:33,203 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for cb9464752b5ad5b19e32ab69fb72a292: Waiting for close lock at 1676261013203Disabling compacts and flushes for region at 1676261013203Disabling writes for close at 1676261013203Writing region close event to WAL at 1676261013203Closed at 1676261013203 2023-02-13 04:03:33,204 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3c481a2d44e2a4fd155314a0041701f4, NAME => 'testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:33,204 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:33,204 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ef40a30f4f57b6d0b3597de97041a459, disabling compactions & flushes 2023-02-13 04:03:33,204 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:33,204 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:33,204 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. after waiting 0 ms 2023-02-13 04:03:33,204 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:33,204 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:33,205 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ef40a30f4f57b6d0b3597de97041a459: Waiting for close lock at 1676261013204Disabling compacts and flushes for region at 1676261013204Disabling writes for close at 1676261013204Writing region close event to WAL at 1676261013204Closed at 1676261013204 2023-02-13 04:03:33,205 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => dc6b2d2002459ad34b0efeeb03100144, NAME => 'testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:33,228 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:33,228 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:33,228 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing dc6b2d2002459ad34b0efeeb03100144, disabling compactions & flushes 2023-02-13 04:03:33,228 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:33,228 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:33,228 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. after waiting 0 ms 2023-02-13 04:03:33,228 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:33,229 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:33,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for dc6b2d2002459ad34b0efeeb03100144: Waiting for close lock at 1676261013228Disabling compacts and flushes for region at 1676261013228Disabling writes for close at 1676261013228Writing region close event to WAL at 1676261013229 (+1 ms)Closed at 1676261013229 2023-02-13 04:03:33,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing cd276396ab5ce2b0b9332f4d4be9f49f, disabling compactions & flushes 2023-02-13 04:03:33,229 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:33,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:33,229 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e5a407ccfe975eabb2dfab30fc24310e, NAME => 'testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp 2023-02-13 04:03:33,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. after waiting 0 ms 2023-02-13 04:03:33,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:33,229 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:33,229 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for cd276396ab5ce2b0b9332f4d4be9f49f: Waiting for close lock at 1676261013229Disabling compacts and flushes for region at 1676261013229Disabling writes for close at 1676261013229Writing region close event to WAL at 1676261013229Closed at 1676261013229 2023-02-13 04:03:33,246 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:33,246 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e5a407ccfe975eabb2dfab30fc24310e, disabling compactions & flushes 2023-02-13 04:03:33,246 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:33,246 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:33,246 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. after waiting 0 ms 2023-02-13 04:03:33,246 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:33,246 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:33,247 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e5a407ccfe975eabb2dfab30fc24310e: Waiting for close lock at 1676261013246Disabling compacts and flushes for region at 1676261013246Disabling writes for close at 1676261013246Writing region close event to WAL at 1676261013246Closed at 1676261013246 2023-02-13 04:03:33,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:33,630 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:33,630 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3c481a2d44e2a4fd155314a0041701f4, disabling compactions & flushes 2023-02-13 04:03:33,630 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:33,630 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:33,630 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. after waiting 0 ms 2023-02-13 04:03:33,630 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:33,630 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:33,630 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3c481a2d44e2a4fd155314a0041701f4: Waiting for close lock at 1676261013630Disabling compacts and flushes for region at 1676261013630Disabling writes for close at 1676261013630Writing region close event to WAL at 1676261013630Closed at 1676261013630 2023-02-13 04:03:33,636 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:03:33,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261013637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261013637"}]},"ts":"1676261013637"} 2023-02-13 04:03:33,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261013637"}]},"ts":"1676261013637"} 2023-02-13 04:03:33,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261013637"}]},"ts":"1676261013637"} 2023-02-13 04:03:33,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261013637"}]},"ts":"1676261013637"} 2023-02-13 04:03:33,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261013637"}]},"ts":"1676261013637"} 2023-02-13 04:03:33,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261013637"}]},"ts":"1676261013637"} 2023-02-13 04:03:33,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261013637"}]},"ts":"1676261013637"} 2023-02-13 04:03:33,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261013637"}]},"ts":"1676261013637"} 2023-02-13 04:03:33,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261013637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261013637"}]},"ts":"1676261013637"} 2023-02-13 04:03:33,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261013637"}]},"ts":"1676261013637"} 2023-02-13 04:03:33,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:33,685 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 04:03:33,687 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:03:33,688 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261013687"}]},"ts":"1676261013687"} 2023-02-13 04:03:33,690 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 04:03:33,696 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:33,708 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:33,709 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:33,709 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:33,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e908bf8c87ab34e33cb35ccd524fbb61, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5015f186b2add7597cdf44bd360bc815, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e6ef3bb677a3d00689bba717531bd7f4, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4eb1de542dca16f0a37b4785daf70ae5, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cb9464752b5ad5b19e32ab69fb72a292, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ef40a30f4f57b6d0b3597de97041a459, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cd276396ab5ce2b0b9332f4d4be9f49f, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c481a2d44e2a4fd155314a0041701f4, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dc6b2d2002459ad34b0efeeb03100144, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e5a407ccfe975eabb2dfab30fc24310e, ASSIGN}] 2023-02-13 04:03:33,714 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e908bf8c87ab34e33cb35ccd524fbb61, ASSIGN 2023-02-13 04:03:33,714 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cb9464752b5ad5b19e32ab69fb72a292, ASSIGN 2023-02-13 04:03:33,715 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5015f186b2add7597cdf44bd360bc815, ASSIGN 2023-02-13 04:03:33,715 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ef40a30f4f57b6d0b3597de97041a459, ASSIGN 2023-02-13 04:03:33,716 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e908bf8c87ab34e33cb35ccd524fbb61, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41187,1676261010144; forceNewPlan=false, retain=false 2023-02-13 04:03:33,716 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cb9464752b5ad5b19e32ab69fb72a292, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41187,1676261010144; forceNewPlan=false, retain=false 2023-02-13 04:03:33,717 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e5a407ccfe975eabb2dfab30fc24310e, ASSIGN 2023-02-13 04:03:33,717 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5015f186b2add7597cdf44bd360bc815, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41187,1676261010144; forceNewPlan=false, retain=false 2023-02-13 04:03:33,717 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ef40a30f4f57b6d0b3597de97041a459, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1676261010095; forceNewPlan=false, retain=false 2023-02-13 04:03:33,718 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dc6b2d2002459ad34b0efeeb03100144, ASSIGN 2023-02-13 04:03:33,718 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c481a2d44e2a4fd155314a0041701f4, ASSIGN 2023-02-13 04:03:33,718 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e5a407ccfe975eabb2dfab30fc24310e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41187,1676261010144; forceNewPlan=false, retain=false 2023-02-13 04:03:33,718 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cd276396ab5ce2b0b9332f4d4be9f49f, ASSIGN 2023-02-13 04:03:33,718 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4eb1de542dca16f0a37b4785daf70ae5, ASSIGN 2023-02-13 04:03:33,719 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dc6b2d2002459ad34b0efeeb03100144, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41187,1676261010144; forceNewPlan=false, retain=false 2023-02-13 04:03:33,720 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3c481a2d44e2a4fd155314a0041701f4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1676261010095; forceNewPlan=false, retain=false 2023-02-13 04:03:33,720 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cd276396ab5ce2b0b9332f4d4be9f49f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1676261010095; forceNewPlan=false, retain=false 2023-02-13 04:03:33,720 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4eb1de542dca16f0a37b4785daf70ae5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1676261010095; forceNewPlan=false, retain=false 2023-02-13 04:03:33,720 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e6ef3bb677a3d00689bba717531bd7f4, ASSIGN 2023-02-13 04:03:33,722 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e6ef3bb677a3d00689bba717531bd7f4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1676261010095; forceNewPlan=false, retain=false 2023-02-13 04:03:33,867 INFO [jenkins-hbase4:40081] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 04:03:33,870 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e5a407ccfe975eabb2dfab30fc24310e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:33,870 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5015f186b2add7597cdf44bd360bc815, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:33,870 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=dc6b2d2002459ad34b0efeeb03100144, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:33,870 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261013870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261013870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261013870"}]},"ts":"1676261013870"} 2023-02-13 04:03:33,870 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e908bf8c87ab34e33cb35ccd524fbb61, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:33,870 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261013870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261013870"}]},"ts":"1676261013870"} 2023-02-13 04:03:33,870 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cb9464752b5ad5b19e32ab69fb72a292, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:33,870 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261013870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261013870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261013870"}]},"ts":"1676261013870"} 2023-02-13 04:03:33,870 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261013870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261013870"}]},"ts":"1676261013870"} 2023-02-13 04:03:33,871 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261013870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261013870"}]},"ts":"1676261013870"} 2023-02-13 04:03:33,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure e5a407ccfe975eabb2dfab30fc24310e, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:33,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=12, state=RUNNABLE; OpenRegionProcedure 5015f186b2add7597cdf44bd360bc815, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:33,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure e908bf8c87ab34e33cb35ccd524fbb61, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:33,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=19, state=RUNNABLE; OpenRegionProcedure dc6b2d2002459ad34b0efeeb03100144, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:33,880 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ef40a30f4f57b6d0b3597de97041a459, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:33,881 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013880"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261013880"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261013880"}]},"ts":"1676261013880"} 2023-02-13 04:03:33,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure cb9464752b5ad5b19e32ab69fb72a292, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:33,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=16, state=RUNNABLE; OpenRegionProcedure ef40a30f4f57b6d0b3597de97041a459, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:33,885 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=cd276396ab5ce2b0b9332f4d4be9f49f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:33,885 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261013885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261013885"}]},"ts":"1676261013885"} 2023-02-13 04:03:33,886 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e6ef3bb677a3d00689bba717531bd7f4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:33,887 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261013886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261013886"}]},"ts":"1676261013886"} 2023-02-13 04:03:33,888 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=17, state=RUNNABLE; OpenRegionProcedure cd276396ab5ce2b0b9332f4d4be9f49f, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:33,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure e6ef3bb677a3d00689bba717531bd7f4, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:33,899 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3c481a2d44e2a4fd155314a0041701f4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:33,899 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4eb1de542dca16f0a37b4785daf70ae5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:33,900 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013899"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261013899"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261013899"}]},"ts":"1676261013899"} 2023-02-13 04:03:33,900 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261013899"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261013899"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261013899"}]},"ts":"1676261013899"} 2023-02-13 04:03:33,908 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 3c481a2d44e2a4fd155314a0041701f4, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:33,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 4eb1de542dca16f0a37b4785daf70ae5, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:34,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:34,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:34,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ef40a30f4f57b6d0b3597de97041a459, NAME => 'testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 04:03:34,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e908bf8c87ab34e33cb35ccd524fbb61, NAME => 'testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 04:03:34,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:34,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:34,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:34,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:34,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:34,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:34,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:34,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:34,067 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:34,067 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:34,069 DEBUG [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/f1 2023-02-13 04:03:34,069 DEBUG [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/f1 2023-02-13 04:03:34,070 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e908bf8c87ab34e33cb35ccd524fbb61 columnFamilyName f1 2023-02-13 04:03:34,070 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] regionserver.HStore(310): Store=e908bf8c87ab34e33cb35ccd524fbb61/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,071 DEBUG [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1 2023-02-13 04:03:34,071 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:34,071 DEBUG [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1 2023-02-13 04:03:34,072 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef40a30f4f57b6d0b3597de97041a459 columnFamilyName f1 2023-02-13 04:03:34,073 DEBUG [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/f2 2023-02-13 04:03:34,074 DEBUG [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/f2 2023-02-13 04:03:34,074 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] regionserver.HStore(310): Store=ef40a30f4f57b6d0b3597de97041a459/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,074 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:34,075 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e908bf8c87ab34e33cb35ccd524fbb61 columnFamilyName f2 2023-02-13 04:03:34,075 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] regionserver.HStore(310): Store=e908bf8c87ab34e33cb35ccd524fbb61/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:34,079 DEBUG [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2 2023-02-13 04:03:34,079 DEBUG [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2 2023-02-13 04:03:34,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:34,080 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef40a30f4f57b6d0b3597de97041a459 columnFamilyName f2 2023-02-13 04:03:34,081 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] regionserver.HStore(310): Store=ef40a30f4f57b6d0b3597de97041a459/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:34,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:34,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:34,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:34,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:34,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:34,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:34,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e908bf8c87ab34e33cb35ccd524fbb61; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62435362, jitterRate=-0.06964060664176941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:34,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e908bf8c87ab34e33cb35ccd524fbb61: Running coprocessor pre-open hook at 1676261014065Writing region info on filesystem at 1676261014065Initializing all the Stores at 1676261014066 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014066Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014066Cleaning up temporary data from old regions at 1676261014081 (+15 ms)Cleaning up detritus from prior splits at 1676261014082 (+1 ms)Running coprocessor post-open hooks at 1676261014091 (+9 ms)Region opened successfully at 1676261014091 2023-02-13 04:03:34,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61., pid=23, masterSystemTime=1676261014045 2023-02-13 04:03:34,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:34,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:34,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:34,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e5a407ccfe975eabb2dfab30fc24310e, NAME => 'testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 04:03:34,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:34,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:34,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:34,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:34,098 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e908bf8c87ab34e33cb35ccd524fbb61, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:34,099 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261014098"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261014098"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261014098"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261014098"}]},"ts":"1676261014098"} 2023-02-13 04:03:34,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:34,105 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:34,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ef40a30f4f57b6d0b3597de97041a459; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59106788, jitterRate=-0.11924022436141968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:34,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ef40a30f4f57b6d0b3597de97041a459: Running coprocessor pre-open hook at 1676261014065Writing region info on filesystem at 1676261014065Initializing all the Stores at 1676261014067 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014067Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014067Cleaning up temporary data from old regions at 1676261014086 (+19 ms)Cleaning up detritus from prior splits at 1676261014087 (+1 ms)Running coprocessor post-open hooks at 1676261014106 (+19 ms)Region opened successfully at 1676261014106 2023-02-13 04:03:34,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-13 04:03:34,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure e908bf8c87ab34e33cb35ccd524fbb61, server=jenkins-hbase4.apache.org,41187,1676261010144 in 225 msec 2023-02-13 04:03:34,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459., pid=26, masterSystemTime=1676261014042 2023-02-13 04:03:34,108 DEBUG [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/f1 2023-02-13 04:03:34,108 DEBUG [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/f1 2023-02-13 04:03:34,109 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5a407ccfe975eabb2dfab30fc24310e columnFamilyName f1 2023-02-13 04:03:34,110 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e908bf8c87ab34e33cb35ccd524fbb61, ASSIGN in 398 msec 2023-02-13 04:03:34,110 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] regionserver.HStore(310): Store=e5a407ccfe975eabb2dfab30fc24310e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,110 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:34,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:34,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:34,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:34,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e6ef3bb677a3d00689bba717531bd7f4, NAME => 'testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 04:03:34,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:34,112 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ef40a30f4f57b6d0b3597de97041a459, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:34,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:34,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:34,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:34,112 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261014112"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261014112"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261014112"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261014112"}]},"ts":"1676261014112"} 2023-02-13 04:03:34,113 DEBUG [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/f2 2023-02-13 04:03:34,113 DEBUG [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/f2 2023-02-13 04:03:34,114 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5a407ccfe975eabb2dfab30fc24310e columnFamilyName f2 2023-02-13 04:03:34,115 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:34,122 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] regionserver.HStore(310): Store=e5a407ccfe975eabb2dfab30fc24310e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=16 2023-02-13 04:03:34,124 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=16, state=SUCCESS; OpenRegionProcedure ef40a30f4f57b6d0b3597de97041a459, server=jenkins-hbase4.apache.org,35817,1676261010095 in 232 msec 2023-02-13 04:03:34,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:34,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:34,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ef40a30f4f57b6d0b3597de97041a459, ASSIGN in 415 msec 2023-02-13 04:03:34,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:34,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:34,133 DEBUG [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1 2023-02-13 04:03:34,133 DEBUG [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1 2023-02-13 04:03:34,134 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6ef3bb677a3d00689bba717531bd7f4 columnFamilyName f1 2023-02-13 04:03:34,135 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] regionserver.HStore(310): Store=e6ef3bb677a3d00689bba717531bd7f4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,135 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:34,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:34,139 DEBUG [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2 2023-02-13 04:03:34,139 DEBUG [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2 2023-02-13 04:03:34,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e5a407ccfe975eabb2dfab30fc24310e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61676058, jitterRate=-0.08095511794090271}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:34,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e5a407ccfe975eabb2dfab30fc24310e: Running coprocessor pre-open hook at 1676261014098Writing region info on filesystem at 1676261014098Initializing all the Stores at 1676261014100 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014100Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014104 (+4 ms)Cleaning up temporary data from old regions at 1676261014127 (+23 ms)Cleaning up detritus from prior splits at 1676261014128 (+1 ms)Running coprocessor post-open hooks at 1676261014139 (+11 ms)Region opened successfully at 1676261014139 2023-02-13 04:03:34,141 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6ef3bb677a3d00689bba717531bd7f4 columnFamilyName f2 2023-02-13 04:03:34,142 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] regionserver.HStore(310): Store=e6ef3bb677a3d00689bba717531bd7f4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e., pid=21, masterSystemTime=1676261014045 2023-02-13 04:03:34,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:34,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:34,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:34,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:34,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:34,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cb9464752b5ad5b19e32ab69fb72a292, NAME => 'testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 04:03:34,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:34,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:34,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:34,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:34,161 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e5a407ccfe975eabb2dfab30fc24310e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:34,162 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261014161"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261014161"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261014161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261014161"}]},"ts":"1676261014161"} 2023-02-13 04:03:34,168 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-13 04:03:34,168 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure e5a407ccfe975eabb2dfab30fc24310e, server=jenkins-hbase4.apache.org,41187,1676261010144 in 292 msec 2023-02-13 04:03:34,184 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:34,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e5a407ccfe975eabb2dfab30fc24310e, ASSIGN in 459 msec 2023-02-13 04:03:34,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:34,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:34,190 DEBUG [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1 2023-02-13 04:03:34,191 DEBUG [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1 2023-02-13 04:03:34,191 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb9464752b5ad5b19e32ab69fb72a292 columnFamilyName f1 2023-02-13 04:03:34,192 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] regionserver.HStore(310): Store=cb9464752b5ad5b19e32ab69fb72a292/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,192 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:34,194 DEBUG [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2 2023-02-13 04:03:34,194 DEBUG [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2 2023-02-13 04:03:34,195 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb9464752b5ad5b19e32ab69fb72a292 columnFamilyName f2 2023-02-13 04:03:34,196 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] regionserver.HStore(310): Store=cb9464752b5ad5b19e32ab69fb72a292/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:34,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:34,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:34,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:34,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:34,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e6ef3bb677a3d00689bba717531bd7f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59479181, jitterRate=-0.11369113624095917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:34,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e6ef3bb677a3d00689bba717531bd7f4: Running coprocessor pre-open hook at 1676261014112Writing region info on filesystem at 1676261014112Initializing all the Stores at 1676261014114 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014114Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014115 (+1 ms)Cleaning up temporary data from old regions at 1676261014163 (+48 ms)Cleaning up detritus from prior splits at 1676261014184 (+21 ms)Running coprocessor post-open hooks at 1676261014202 (+18 ms)Region opened successfully at 1676261014202 2023-02-13 04:03:34,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4., pid=28, masterSystemTime=1676261014042 2023-02-13 04:03:34,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:34,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:34,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:34,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:34,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4eb1de542dca16f0a37b4785daf70ae5, NAME => 'testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 04:03:34,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:34,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:34,207 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e6ef3bb677a3d00689bba717531bd7f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:34,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:34,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:34,208 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261014207"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261014207"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261014207"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261014207"}]},"ts":"1676261014207"} 2023-02-13 04:03:34,209 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:34,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:34,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cb9464752b5ad5b19e32ab69fb72a292; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68222958, jitterRate=0.01660129427909851}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:34,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cb9464752b5ad5b19e32ab69fb72a292: Running coprocessor pre-open hook at 1676261014161Writing region info on filesystem at 1676261014161Initializing all the Stores at 1676261014164 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014164Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014171 (+7 ms)Cleaning up temporary data from old regions at 1676261014199 (+28 ms)Cleaning up detritus from prior splits at 1676261014200 (+1 ms)Running coprocessor post-open hooks at 1676261014211 (+11 ms)Region opened successfully at 1676261014211 2023-02-13 04:03:34,212 DEBUG [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1 2023-02-13 04:03:34,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292., pid=25, masterSystemTime=1676261014045 2023-02-13 04:03:34,212 DEBUG [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1 2023-02-13 04:03:34,212 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4eb1de542dca16f0a37b4785daf70ae5 columnFamilyName f1 2023-02-13 04:03:34,213 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] regionserver.HStore(310): Store=4eb1de542dca16f0a37b4785daf70ae5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,213 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:34,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:34,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:34,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:34,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-13 04:03:34,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure e6ef3bb677a3d00689bba717531bd7f4, server=jenkins-hbase4.apache.org,35817,1676261010095 in 321 msec 2023-02-13 04:03:34,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5015f186b2add7597cdf44bd360bc815, NAME => 'testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 04:03:34,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:34,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:34,215 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cb9464752b5ad5b19e32ab69fb72a292, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:34,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:34,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:34,215 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261014215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261014215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261014215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261014215"}]},"ts":"1676261014215"} 2023-02-13 04:03:34,216 DEBUG [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2 2023-02-13 04:03:34,216 DEBUG [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2 2023-02-13 04:03:34,216 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4eb1de542dca16f0a37b4785daf70ae5 columnFamilyName f2 2023-02-13 04:03:34,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e6ef3bb677a3d00689bba717531bd7f4, ASSIGN in 506 msec 2023-02-13 04:03:34,217 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] regionserver.HStore(310): Store=4eb1de542dca16f0a37b4785daf70ae5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,217 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:34,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:34,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:34,220 DEBUG [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1 2023-02-13 04:03:34,220 DEBUG [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1 2023-02-13 04:03:34,221 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5015f186b2add7597cdf44bd360bc815 columnFamilyName f1 2023-02-13 04:03:34,222 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] regionserver.HStore(310): Store=5015f186b2add7597cdf44bd360bc815/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,222 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:34,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-13 04:03:34,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:34,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure cb9464752b5ad5b19e32ab69fb72a292, server=jenkins-hbase4.apache.org,41187,1676261010144 in 336 msec 2023-02-13 04:03:34,224 DEBUG [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2 2023-02-13 04:03:34,224 DEBUG [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2 2023-02-13 04:03:34,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cb9464752b5ad5b19e32ab69fb72a292, ASSIGN in 513 msec 2023-02-13 04:03:34,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:34,225 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5015f186b2add7597cdf44bd360bc815 columnFamilyName f2 2023-02-13 04:03:34,226 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] regionserver.HStore(310): Store=5015f186b2add7597cdf44bd360bc815/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:34,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:34,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:34,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:34,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4eb1de542dca16f0a37b4785daf70ae5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61242056, jitterRate=-0.08742225170135498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:34,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4eb1de542dca16f0a37b4785daf70ae5: Running coprocessor pre-open hook at 1676261014208Writing region info on filesystem at 1676261014208Initializing all the Stores at 1676261014209 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014209Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014209Cleaning up temporary data from old regions at 1676261014221 (+12 ms)Cleaning up detritus from prior splits at 1676261014221Running coprocessor post-open hooks at 1676261014234 (+13 ms)Region opened successfully at 1676261014234 2023-02-13 04:03:34,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:34,235 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5., pid=30, masterSystemTime=1676261014042 2023-02-13 04:03:34,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:34,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:34,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:34,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:34,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cd276396ab5ce2b0b9332f4d4be9f49f, NAME => 'testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 04:03:34,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:34,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:34,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:34,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5015f186b2add7597cdf44bd360bc815; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69499647, jitterRate=0.03562544286251068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:34,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:34,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5015f186b2add7597cdf44bd360bc815: Running coprocessor pre-open hook at 1676261014215Writing region info on filesystem at 1676261014215Initializing all the Stores at 1676261014217 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014217Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014217Cleaning up temporary data from old regions at 1676261014230 (+13 ms)Cleaning up detritus from prior splits at 1676261014230Running coprocessor post-open hooks at 1676261014239 (+9 ms)Region opened successfully at 1676261014239 2023-02-13 04:03:34,239 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4eb1de542dca16f0a37b4785daf70ae5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:34,239 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261014239"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261014239"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261014239"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261014239"}]},"ts":"1676261014239"} 2023-02-13 04:03:34,240 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815., pid=22, masterSystemTime=1676261014045 2023-02-13 04:03:34,242 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:34,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:34,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:34,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:34,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dc6b2d2002459ad34b0efeeb03100144, NAME => 'testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 04:03:34,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:34,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:34,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:34,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:34,244 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=5015f186b2add7597cdf44bd360bc815, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:34,245 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261014244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261014244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261014244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261014244"}]},"ts":"1676261014244"} 2023-02-13 04:03:34,246 DEBUG [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1 2023-02-13 04:03:34,247 DEBUG [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1 2023-02-13 04:03:34,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-13 04:03:34,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 4eb1de542dca16f0a37b4785daf70ae5, server=jenkins-hbase4.apache.org,35817,1676261010095 in 329 msec 2023-02-13 04:03:34,247 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:34,247 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd276396ab5ce2b0b9332f4d4be9f49f columnFamilyName f1 2023-02-13 04:03:34,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4eb1de542dca16f0a37b4785daf70ae5, ASSIGN in 538 msec 2023-02-13 04:03:34,250 DEBUG [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1 2023-02-13 04:03:34,250 DEBUG [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1 2023-02-13 04:03:34,251 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] regionserver.HStore(310): Store=cd276396ab5ce2b0b9332f4d4be9f49f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,251 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:34,251 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc6b2d2002459ad34b0efeeb03100144 columnFamilyName f1 2023-02-13 04:03:34,252 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] regionserver.HStore(310): Store=dc6b2d2002459ad34b0efeeb03100144/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=12 2023-02-13 04:03:34,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=12, state=SUCCESS; OpenRegionProcedure 5015f186b2add7597cdf44bd360bc815, server=jenkins-hbase4.apache.org,41187,1676261010144 in 373 msec 2023-02-13 04:03:34,252 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:34,253 DEBUG [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2 2023-02-13 04:03:34,253 DEBUG [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2 2023-02-13 04:03:34,254 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd276396ab5ce2b0b9332f4d4be9f49f columnFamilyName f2 2023-02-13 04:03:34,254 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] regionserver.HStore(310): Store=cd276396ab5ce2b0b9332f4d4be9f49f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,255 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5015f186b2add7597cdf44bd360bc815, ASSIGN in 543 msec 2023-02-13 04:03:34,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:34,256 DEBUG [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2 2023-02-13 04:03:34,257 DEBUG [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2 2023-02-13 04:03:34,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:34,257 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc6b2d2002459ad34b0efeeb03100144 columnFamilyName f2 2023-02-13 04:03:34,258 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] regionserver.HStore(310): Store=dc6b2d2002459ad34b0efeeb03100144/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:34,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:34,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:34,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:34,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:34,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cd276396ab5ce2b0b9332f4d4be9f49f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63534742, jitterRate=-0.05325856804847717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:34,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cd276396ab5ce2b0b9332f4d4be9f49f: Running coprocessor pre-open hook at 1676261014239Writing region info on filesystem at 1676261014239Initializing all the Stores at 1676261014241 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014241Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014242 (+1 ms)Cleaning up temporary data from old regions at 1676261014259 (+17 ms)Cleaning up detritus from prior splits at 1676261014260 (+1 ms)Running coprocessor post-open hooks at 1676261014268 (+8 ms)Region opened successfully at 1676261014268 2023-02-13 04:03:34,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:34,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f., pid=27, masterSystemTime=1676261014042 2023-02-13 04:03:34,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dc6b2d2002459ad34b0efeeb03100144; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68737964, jitterRate=0.024275481700897217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:34,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dc6b2d2002459ad34b0efeeb03100144: Running coprocessor pre-open hook at 1676261014244Writing region info on filesystem at 1676261014244Initializing all the Stores at 1676261014246 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014246Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014247 (+1 ms)Cleaning up temporary data from old regions at 1676261014262 (+15 ms)Cleaning up detritus from prior splits at 1676261014263 (+1 ms)Running coprocessor post-open hooks at 1676261014270 (+7 ms)Region opened successfully at 1676261014270 2023-02-13 04:03:34,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144., pid=24, masterSystemTime=1676261014045 2023-02-13 04:03:34,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:34,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:34,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:34,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3c481a2d44e2a4fd155314a0041701f4, NAME => 'testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 04:03:34,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:34,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:34,273 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=cd276396ab5ce2b0b9332f4d4be9f49f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:34,273 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261014273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261014273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261014273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261014273"}]},"ts":"1676261014273"} 2023-02-13 04:03:34,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:34,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:34,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:34,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:34,275 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:34,275 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=dc6b2d2002459ad34b0efeeb03100144, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:34,275 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261014275"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261014275"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261014275"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261014275"}]},"ts":"1676261014275"} 2023-02-13 04:03:34,277 DEBUG [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1 2023-02-13 04:03:34,278 DEBUG [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1 2023-02-13 04:03:34,278 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c481a2d44e2a4fd155314a0041701f4 columnFamilyName f1 2023-02-13 04:03:34,280 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] regionserver.HStore(310): Store=3c481a2d44e2a4fd155314a0041701f4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,280 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:34,280 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=17 2023-02-13 04:03:34,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=17, state=SUCCESS; OpenRegionProcedure cd276396ab5ce2b0b9332f4d4be9f49f, server=jenkins-hbase4.apache.org,35817,1676261010095 in 388 msec 2023-02-13 04:03:34,283 DEBUG [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2 2023-02-13 04:03:34,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=19 2023-02-13 04:03:34,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=19, state=SUCCESS; OpenRegionProcedure dc6b2d2002459ad34b0efeeb03100144, server=jenkins-hbase4.apache.org,41187,1676261010144 in 398 msec 2023-02-13 04:03:34,283 DEBUG [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2 2023-02-13 04:03:34,284 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c481a2d44e2a4fd155314a0041701f4 columnFamilyName f2 2023-02-13 04:03:34,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cd276396ab5ce2b0b9332f4d4be9f49f, ASSIGN in 572 msec 2023-02-13 04:03:34,285 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] regionserver.HStore(310): Store=3c481a2d44e2a4fd155314a0041701f4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:34,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dc6b2d2002459ad34b0efeeb03100144, ASSIGN in 574 msec 2023-02-13 04:03:34,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:34,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:34,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:34,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:34,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:34,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3c481a2d44e2a4fd155314a0041701f4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68323951, jitterRate=0.018106207251548767}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:34,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3c481a2d44e2a4fd155314a0041701f4: Running coprocessor pre-open hook at 1676261014273Writing region info on filesystem at 1676261014273Initializing all the Stores at 1676261014274 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014275 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261014275Cleaning up temporary data from old regions at 1676261014288 (+13 ms)Cleaning up detritus from prior splits at 1676261014289 (+1 ms)Running coprocessor post-open hooks at 1676261014294 (+5 ms)Region opened successfully at 1676261014294 2023-02-13 04:03:34,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4., pid=29, masterSystemTime=1676261014042 2023-02-13 04:03:34,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:34,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:34,298 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3c481a2d44e2a4fd155314a0041701f4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:34,298 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261014298"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261014298"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261014298"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261014298"}]},"ts":"1676261014298"} 2023-02-13 04:03:34,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-13 04:03:34,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 3c481a2d44e2a4fd155314a0041701f4, server=jenkins-hbase4.apache.org,35817,1676261010095 in 392 msec 2023-02-13 04:03:34,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-13 04:03:34,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3c481a2d44e2a4fd155314a0041701f4, ASSIGN in 594 msec 2023-02-13 04:03:34,307 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:03:34,307 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261014307"}]},"ts":"1676261014307"} 2023-02-13 04:03:34,310 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 04:03:34,313 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:03:34,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.2890 sec 2023-02-13 04:03:35,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:35,190 INFO [Listener at localhost/42775] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 04:03:35,191 DEBUG [Listener at localhost/42775] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 04:03:35,193 INFO [Listener at localhost/42775] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:03:35,204 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 04:03:35,205 INFO [Listener at localhost/42775] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:03:35,205 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 04:03:35,205 INFO [Listener at localhost/42775] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 04:03:35,338 DEBUG [hconnection-0x79d91649-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:35,404 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38462, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:35,446 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41187] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 7436 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:35,447 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35817] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10140 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:35,791 INFO [Listener at localhost/42775] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 04:03:35,795 INFO [Listener at localhost/42775] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 04:03:35,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 04:03:35,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676261015810 (current time:1676261015810). 2023-02-13 04:03:35,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 04:03:35,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] zookeeper.ReadOnlyZKClient(139): Connect 0x46c326ba to 127.0.0.1:60256 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:35,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@588a8909, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:35,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:35,825 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38408, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:35,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46c326ba to 127.0.0.1:60256 2023-02-13 04:03:35,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:35,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 04:03:35,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 04:03:35,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 04:03:35,857 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 04:03:35,859 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676261615859 2023-02-13 04:03:35,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 04:03:35,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 04:03:35,862 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 04:03:35,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 04:03:35,866 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 04:03:35,867 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 04:03:35,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 17 msec 2023-02-13 04:03:35,868 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 04:03:35,869 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676261615869 2023-02-13 04:03:35,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-13 04:03:35,924 INFO [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-13 04:03:35,924 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:35,924 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-13 04:03:35,924 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 04:03:35,925 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:35,925 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 04:03:35,927 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:35,927 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:35,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:35,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:35,927 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:35,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:35,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:35,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 04:03:35,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:35,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 04:03:35,930 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:35,931 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:35,931 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:35,931 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:03:35,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-13 04:03:35,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 04:03:35,932 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 04:03:35,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:35,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-13 04:03:35,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 04:03:35,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 04:03:35,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-13 04:03:35,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-13 04:03:35,937 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-13 04:03:35,937 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-13 04:03:35,937 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:35,937 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:35,938 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 04:03:35,938 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 04:03:35,938 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-13 04:03:35,938 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-13 04:03:35,938 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35817,1676261010095' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-13 04:03:35,938 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41187,1676261010144' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-13 04:03:35,940 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,940 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:35,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:35,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:35,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:35,941 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:35,941 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:35,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:35,942 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,943 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 04:03:35,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:35,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:35,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:35,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35817,1676261010095' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-13 04:03:35,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f1b95ef[Count = 1] remaining members to acquire global barrier 2023-02-13 04:03:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 04:03:35,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:35,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:35,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:35,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41187,1676261010144' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-13 04:03:35,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f1b95ef[Count = 0] remaining members to acquire global barrier 2023-02-13 04:03:35,948 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 04:03:35,948 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,950 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,950 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:35,950 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 04:03:35,952 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 04:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:35,952 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:35,952 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:35,953 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:35,953 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. started... 2023-02-13 04:03:35,953 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. started... 2023-02-13 04:03:35,953 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. started... 2023-02-13 04:03:35,953 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:03:35,955 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5015f186b2add7597cdf44bd360bc815 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 04:03:35,955 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ef40a30f4f57b6d0b3597de97041a459 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:35,955 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e6ef3bb677a3d00689bba717531bd7f4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:35,955 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 04:03:35,956 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:03:35,956 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:35,956 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 04:03:35,956 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:35,956 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:35,956 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. started... 2023-02-13 04:03:35,956 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:03:35,956 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. started... 2023-02-13 04:03:35,956 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. started... 2023-02-13 04:03:35,957 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] regionserver.HRegion(2744): Flushing cb9464752b5ad5b19e32ab69fb72a292 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:35,958 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] regionserver.HRegion(2744): Flushing cd276396ab5ce2b0b9332f4d4be9f49f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:35,958 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] regionserver.HRegion(2744): Flushing dc6b2d2002459ad34b0efeeb03100144 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 04:03:35,967 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:35,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:03:35,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:03:35,973 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 04:03:36,173 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:36,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:03:36,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:03:36,176 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 04:03:36,223 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/.tmp/f1/0b8d656a03604c5d8e8e2b3e85831375 2023-02-13 04:03:36,228 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/.tmp/f1/46ea15019f5a49d2bd557d03933bfdc6 2023-02-13 04:03:36,229 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/.tmp/f1/a584a49b66c043f6975255fc463f5558 2023-02-13 04:03:36,233 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/.tmp/f1/93fccdfb380d4b7cbabd416a61739a4f 2023-02-13 04:03:36,249 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/.tmp/f1/70a31ab1db824310b84bbaa3be41788a 2023-02-13 04:03:36,369 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/.tmp/f2/6424daf9706a4f3d8cdb393f0f49f2e9 2023-02-13 04:03:36,372 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/.tmp/f2/852a27b6b2cf40cc98ac1d146b896045 2023-02-13 04:03:36,382 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/.tmp/f1/a584a49b66c043f6975255fc463f5558 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/a584a49b66c043f6975255fc463f5558 2023-02-13 04:03:36,385 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/.tmp/f1/46ea15019f5a49d2bd557d03933bfdc6 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/46ea15019f5a49d2bd557d03933bfdc6 2023-02-13 04:03:36,399 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/46ea15019f5a49d2bd557d03933bfdc6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,401 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/.tmp/f2/852a27b6b2cf40cc98ac1d146b896045 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/852a27b6b2cf40cc98ac1d146b896045 2023-02-13 04:03:36,409 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/a584a49b66c043f6975255fc463f5558, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:03:36,413 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/.tmp/f2/6424daf9706a4f3d8cdb393f0f49f2e9 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/6424daf9706a4f3d8cdb393f0f49f2e9 2023-02-13 04:03:36,416 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/.tmp/f2/e8f6d199f0bc4a6ab8d6c973a71e5ec0 2023-02-13 04:03:36,424 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/852a27b6b2cf40cc98ac1d146b896045, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,424 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/6424daf9706a4f3d8cdb393f0f49f2e9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:03:36,425 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/.tmp/f1/70a31ab1db824310b84bbaa3be41788a as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/70a31ab1db824310b84bbaa3be41788a 2023-02-13 04:03:36,426 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 5015f186b2add7597cdf44bd360bc815 in 470ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:36,426 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ef40a30f4f57b6d0b3597de97041a459 in 471ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:36,427 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 04:03:36,427 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 04:03:36,431 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5015f186b2add7597cdf44bd360bc815: 2023-02-13 04:03:36,438 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ef40a30f4f57b6d0b3597de97041a459: 2023-02-13 04:03:36,439 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,439 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,445 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:36,445 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:36,446 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/70a31ab1db824310b84bbaa3be41788a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,448 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/.tmp/f2/e8f6d199f0bc4a6ab8d6c973a71e5ec0 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/e8f6d199f0bc4a6ab8d6c973a71e5ec0 2023-02-13 04:03:36,450 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/46ea15019f5a49d2bd557d03933bfdc6] hfiles 2023-02-13 04:03:36,450 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/a584a49b66c043f6975255fc463f5558] hfiles 2023-02-13 04:03:36,450 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/46ea15019f5a49d2bd557d03933bfdc6 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,450 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/a584a49b66c043f6975255fc463f5558 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,454 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/852a27b6b2cf40cc98ac1d146b896045] hfiles 2023-02-13 04:03:36,454 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/6424daf9706a4f3d8cdb393f0f49f2e9] hfiles 2023-02-13 04:03:36,454 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/852a27b6b2cf40cc98ac1d146b896045 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,454 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/6424daf9706a4f3d8cdb393f0f49f2e9 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,459 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/e8f6d199f0bc4a6ab8d6c973a71e5ec0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,461 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cb9464752b5ad5b19e32ab69fb72a292 in 504ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:36,461 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for cb9464752b5ad5b19e32ab69fb72a292: 2023-02-13 04:03:36,461 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,461 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:36,461 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/70a31ab1db824310b84bbaa3be41788a] hfiles 2023-02-13 04:03:36,461 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/70a31ab1db824310b84bbaa3be41788a for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,461 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/e8f6d199f0bc4a6ab8d6c973a71e5ec0] hfiles 2023-02-13 04:03:36,461 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/e8f6d199f0bc4a6ab8d6c973a71e5ec0 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,474 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. completed. 2023-02-13 04:03:36,474 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:36,475 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:36,475 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. started... 2023-02-13 04:03:36,475 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 04:03:36,476 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e908bf8c87ab34e33cb35ccd524fbb61: 2023-02-13 04:03:36,477 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,477 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:36,477 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:36,477 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:36,477 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:36,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:03:36,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:03:36,481 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 04:03:36,482 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. completed. 2023-02-13 04:03:36,482 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:36,482 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:36,482 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. started... 2023-02-13 04:03:36,482 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 04:03:36,483 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4eb1de542dca16f0a37b4785daf70ae5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:36,483 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. completed. 2023-02-13 04:03:36,483 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:36,483 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:36,483 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. started... 2023-02-13 04:03:36,483 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 04:03:36,484 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e5a407ccfe975eabb2dfab30fc24310e: 2023-02-13 04:03:36,484 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,484 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:36,484 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:36,484 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:36,500 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. completed. 2023-02-13 04:03:36,500 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:36,500 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 04:03:36,512 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. completed. 2023-02-13 04:03:36,512 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:36,512 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 04:03:36,518 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/.tmp/f1/b669d82f8af541d48f0d9d294ced0755 2023-02-13 04:03:36,540 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/.tmp/f2/aa66fc0949fe49d3944ff96ab1bb4594 2023-02-13 04:03:36,548 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/.tmp/f1/b669d82f8af541d48f0d9d294ced0755 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/b669d82f8af541d48f0d9d294ced0755 2023-02-13 04:03:36,556 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/b669d82f8af541d48f0d9d294ced0755, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,557 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/.tmp/f2/aa66fc0949fe49d3944ff96ab1bb4594 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/aa66fc0949fe49d3944ff96ab1bb4594 2023-02-13 04:03:36,566 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/aa66fc0949fe49d3944ff96ab1bb4594, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,567 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4eb1de542dca16f0a37b4785daf70ae5 in 84ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:36,567 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4eb1de542dca16f0a37b4785daf70ae5: 2023-02-13 04:03:36,567 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,568 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:36,568 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/b669d82f8af541d48f0d9d294ced0755] hfiles 2023-02-13 04:03:36,568 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/b669d82f8af541d48f0d9d294ced0755 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,568 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/aa66fc0949fe49d3944ff96ab1bb4594] hfiles 2023-02-13 04:03:36,568 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/aa66fc0949fe49d3944ff96ab1bb4594 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,581 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. completed. 2023-02-13 04:03:36,581 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:36,581 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:36,581 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 04:03:36,581 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. started... 2023-02-13 04:03:36,582 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3c481a2d44e2a4fd155314a0041701f4 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:36,598 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/.tmp/f1/c79a26db14094bd2b244ef2d17233fd6 2023-02-13 04:03:36,624 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/.tmp/f1/2074a337e6cd43079feab7be5d5f56d5 2023-02-13 04:03:36,626 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/.tmp/f2/1f9f0c956b1a444eb93b15bb36d7a774 2023-02-13 04:03:36,634 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/.tmp/f1/c79a26db14094bd2b244ef2d17233fd6 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/c79a26db14094bd2b244ef2d17233fd6 2023-02-13 04:03:36,642 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/c79a26db14094bd2b244ef2d17233fd6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,644 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/.tmp/f2/1f9f0c956b1a444eb93b15bb36d7a774 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/1f9f0c956b1a444eb93b15bb36d7a774 2023-02-13 04:03:36,652 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/1f9f0c956b1a444eb93b15bb36d7a774, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,653 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3c481a2d44e2a4fd155314a0041701f4 in 72ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:36,653 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3c481a2d44e2a4fd155314a0041701f4: 2023-02-13 04:03:36,653 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,653 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:36,653 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/c79a26db14094bd2b244ef2d17233fd6] hfiles 2023-02-13 04:03:36,653 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/c79a26db14094bd2b244ef2d17233fd6 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,653 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/1f9f0c956b1a444eb93b15bb36d7a774] hfiles 2023-02-13 04:03:36,654 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/1f9f0c956b1a444eb93b15bb36d7a774 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,667 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/.tmp/f2/d82f18d0d0ac48ccbaece3b4e89a02a6 2023-02-13 04:03:36,677 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/.tmp/f1/2074a337e6cd43079feab7be5d5f56d5 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/2074a337e6cd43079feab7be5d5f56d5 2023-02-13 04:03:36,683 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. completed. 2023-02-13 04:03:36,683 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:36,683 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 04:03:36,685 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/2074a337e6cd43079feab7be5d5f56d5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,687 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/.tmp/f2/d82f18d0d0ac48ccbaece3b4e89a02a6 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/d82f18d0d0ac48ccbaece3b4e89a02a6 2023-02-13 04:03:36,695 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/d82f18d0d0ac48ccbaece3b4e89a02a6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,697 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cd276396ab5ce2b0b9332f4d4be9f49f in 740ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:36,697 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for cd276396ab5ce2b0b9332f4d4be9f49f: 2023-02-13 04:03:36,697 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,698 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:36,698 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/2074a337e6cd43079feab7be5d5f56d5] hfiles 2023-02-13 04:03:36,698 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/2074a337e6cd43079feab7be5d5f56d5 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,698 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/d82f18d0d0ac48ccbaece3b4e89a02a6] hfiles 2023-02-13 04:03:36,698 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/d82f18d0d0ac48ccbaece3b4e89a02a6 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,719 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. completed. 2023-02-13 04:03:36,719 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:36,719 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 04:03:36,814 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/.tmp/f2/a911c1bd23b44b98b5ce87b1fa6d5f42 2023-02-13 04:03:36,817 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/.tmp/f2/8002dc76e27845a198093849bb0b2572 2023-02-13 04:03:36,824 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/.tmp/f1/93fccdfb380d4b7cbabd416a61739a4f as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/93fccdfb380d4b7cbabd416a61739a4f 2023-02-13 04:03:36,828 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/.tmp/f1/0b8d656a03604c5d8e8e2b3e85831375 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/0b8d656a03604c5d8e8e2b3e85831375 2023-02-13 04:03:36,833 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/93fccdfb380d4b7cbabd416a61739a4f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,834 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/.tmp/f2/a911c1bd23b44b98b5ce87b1fa6d5f42 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/a911c1bd23b44b98b5ce87b1fa6d5f42 2023-02-13 04:03:36,837 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/0b8d656a03604c5d8e8e2b3e85831375, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:03:36,838 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/.tmp/f2/8002dc76e27845a198093849bb0b2572 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/8002dc76e27845a198093849bb0b2572 2023-02-13 04:03:36,841 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/a911c1bd23b44b98b5ce87b1fa6d5f42, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:36,843 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e6ef3bb677a3d00689bba717531bd7f4 in 888ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:36,843 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e6ef3bb677a3d00689bba717531bd7f4: 2023-02-13 04:03:36,843 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,843 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:36,843 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/93fccdfb380d4b7cbabd416a61739a4f] hfiles 2023-02-13 04:03:36,844 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/93fccdfb380d4b7cbabd416a61739a4f for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,844 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/a911c1bd23b44b98b5ce87b1fa6d5f42] hfiles 2023-02-13 04:03:36,844 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/a911c1bd23b44b98b5ce87b1fa6d5f42 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,848 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/8002dc76e27845a198093849bb0b2572, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:03:36,849 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for dc6b2d2002459ad34b0efeeb03100144 in 891ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:36,849 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for dc6b2d2002459ad34b0efeeb03100144: 2023-02-13 04:03:36,849 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,849 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:36,849 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/0b8d656a03604c5d8e8e2b3e85831375] hfiles 2023-02-13 04:03:36,849 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/0b8d656a03604c5d8e8e2b3e85831375 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,849 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/8002dc76e27845a198093849bb0b2572] hfiles 2023-02-13 04:03:36,850 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/8002dc76e27845a198093849bb0b2572 for snapshot=testWithMapReduceMultiRegion 2023-02-13 04:03:36,863 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. completed. 2023-02-13 04:03:36,863 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:36,863 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 04:03:36,863 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 04:03:36,863 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,863 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-13 04:03:36,863 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35817,1676261010095' in zk 2023-02-13 04:03:36,867 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,867 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-13 04:03:36,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,868 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:36,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:36,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:36,868 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-13 04:03:36,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:36,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:36,870 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. completed. 2023-02-13 04:03:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 04:03:36,870 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:36,870 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 04:03:36,870 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 04:03:36,870 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,870 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-13 04:03:36,870 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,41187,1676261010144' in zk 2023-02-13 04:03:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,877 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-13 04:03:36,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:36,877 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,877 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:36,877 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-13 04:03:36,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 04:03:36,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35817,1676261010095': 2023-02-13 04:03:36,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35817,1676261010095' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 04:03:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:36,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:36,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 04:03:36,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:36,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 04:03:36,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,41187,1676261010144': 2023-02-13 04:03:36,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41187,1676261010144' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 04:03:36,884 INFO [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-13 04:03:36,884 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:03:36,884 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:03:36,884 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-13 04:03:36,884 INFO [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 04:03:36,886 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,886 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,886 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:36,886 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:36,887 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:36,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:36,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:36,887 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:36,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:36,888 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 04:03:36,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:36,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 04:03:36,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,896 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:36,897 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 04:03:36,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,934 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,934 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:36,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:36,934 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:36,934 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-13 04:03:36,934 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:36,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:36,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-13 04:03:36,934 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:36,934 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 04:03:36,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:36,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:36,935 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:36,935 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,936 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 04:03:36,936 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:36,936 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:36,936 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:36,936 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 04:03:36,936 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 04:03:36,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:36,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:36,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 04:03:36,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:36,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:36,981 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:36,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:03:36,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:03:36,985 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 04:03:37,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-13 04:03:37,090 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-13 04:03:37,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 04:03:37,091 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 04:03:37,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676261015860Consolidate snapshot: testWithMapReduceMultiRegion at 1676261016935 (+1075 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676261016935Writing data manifest for testWithMapReduceMultiRegion at 1676261016967 (+32 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676261017000 (+33 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676261017090 (+90 ms) 2023-02-13 04:03:37,092 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 04:03:37,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2310 sec 2023-02-13 04:03:37,421 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 04:03:37,483 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 04:03:37,485 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 04:03:37,986 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:37,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:03:37,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 04:03:37,987 INFO [Listener at localhost/42775] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 04:03:37,999 INFO [Listener at localhost/42775] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 04:03:38,012 INFO [Listener at localhost/42775] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 04:03:38,067 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41187] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 7436 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:38,080 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35817] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10140 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:38,226 INFO [Listener at localhost/42775] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 04:03:38,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:03:38,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 04:03:38,250 INFO [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 04:03:38,251 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:03:38,251 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 04:03:38,251 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 04:03:38,252 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,252 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:38,254 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:38,254 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:38,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:38,254 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:38,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:38,255 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,255 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:38,255 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,255 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:03:38,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:03:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:03:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:38,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 04:03:38,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 04:03:38,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 04:03:38,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 04:03:38,258 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 04:03:38,258 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 04:03:38,258 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:03:38,258 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:03:38,259 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 04:03:38,259 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 04:03:38,260 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:38,260 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. started... 2023-02-13 04:03:38,260 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5015f186b2add7597cdf44bd360bc815 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 04:03:38,261 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:38,261 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. started... 2023-02-13 04:03:38,261 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ef40a30f4f57b6d0b3597de97041a459 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:38,264 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:38,264 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:38,265 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:38,265 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 04:03:38,265 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 04:03:38,266 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:03:38,266 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. started... 2023-02-13 04:03:38,265 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:38,265 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. started... 2023-02-13 04:03:38,266 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing dc6b2d2002459ad34b0efeeb03100144 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 04:03:38,266 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e6ef3bb677a3d00689bba717531bd7f4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:38,265 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. started... 2023-02-13 04:03:38,266 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. started... 2023-02-13 04:03:38,268 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cb9464752b5ad5b19e32ab69fb72a292 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:38,268 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing cd276396ab5ce2b0b9332f4d4be9f49f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:38,266 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:03:38,332 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/.tmp/f1/237d0c3ac7024b029aecf4b3ae401eab 2023-02-13 04:03:38,333 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/.tmp/f1/5f7d41e4f42d4db58232b1f35f625f24 2023-02-13 04:03:38,345 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/.tmp/f1/a0a9b8bc0f304826ba9c55931dd5c96a 2023-02-13 04:03:38,349 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/.tmp/f1/e4e35becff5544529c8a6d8fe39d8e6d 2023-02-13 04:03:38,349 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/.tmp/f1/16043ca7727647ddb7a25cf702ef8062 2023-02-13 04:03:38,350 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/.tmp/f1/5cadfc43b5ac4a30b2714b029fa0a82d 2023-02-13 04:03:38,380 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/.tmp/f2/6942910b91674c46a48b27d68000e14c 2023-02-13 04:03:38,386 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/.tmp/f2/e7efde55a2b94a31bdb8cdb73fc89f59 2023-02-13 04:03:38,389 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/.tmp/f1/237d0c3ac7024b029aecf4b3ae401eab as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/237d0c3ac7024b029aecf4b3ae401eab 2023-02-13 04:03:38,394 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/.tmp/f1/5f7d41e4f42d4db58232b1f35f625f24 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/5f7d41e4f42d4db58232b1f35f625f24 2023-02-13 04:03:38,396 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/237d0c3ac7024b029aecf4b3ae401eab, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,396 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/.tmp/f2/47b89da6c4ce41328cf2e896c3a40cc5 2023-02-13 04:03:38,398 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/.tmp/f2/6942910b91674c46a48b27d68000e14c as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/6942910b91674c46a48b27d68000e14c 2023-02-13 04:03:38,401 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/5f7d41e4f42d4db58232b1f35f625f24, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:03:38,403 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/.tmp/f2/e7efde55a2b94a31bdb8cdb73fc89f59 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/e7efde55a2b94a31bdb8cdb73fc89f59 2023-02-13 04:03:38,403 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/.tmp/f2/2d731bb3e7364830855b671749ac18c4 2023-02-13 04:03:38,409 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/6942910b91674c46a48b27d68000e14c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,409 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/.tmp/f1/a0a9b8bc0f304826ba9c55931dd5c96a as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/a0a9b8bc0f304826ba9c55931dd5c96a 2023-02-13 04:03:38,411 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cd276396ab5ce2b0b9332f4d4be9f49f in 143ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:38,411 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cd276396ab5ce2b0b9332f4d4be9f49f: 2023-02-13 04:03:38,411 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:38,411 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:38,411 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. started... 2023-02-13 04:03:38,411 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 04:03:38,411 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4eb1de542dca16f0a37b4785daf70ae5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:38,416 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/.tmp/f2/8dab7ad3b509427fabb2ec6cf70ce274 2023-02-13 04:03:38,417 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/.tmp/f2/3193d93a41fd42aa93da8530b6e07ef0 2023-02-13 04:03:38,418 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/e7efde55a2b94a31bdb8cdb73fc89f59, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:03:38,418 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/.tmp/f1/16043ca7727647ddb7a25cf702ef8062 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/16043ca7727647ddb7a25cf702ef8062 2023-02-13 04:03:38,419 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for dc6b2d2002459ad34b0efeeb03100144 in 153ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:38,419 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for dc6b2d2002459ad34b0efeeb03100144: 2023-02-13 04:03:38,419 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:38,419 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:38,419 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 04:03:38,420 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. started... 2023-02-13 04:03:38,420 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e908bf8c87ab34e33cb35ccd524fbb61: 2023-02-13 04:03:38,420 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:38,420 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 04:03:38,420 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:38,420 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. started... 2023-02-13 04:03:38,420 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e5a407ccfe975eabb2dfab30fc24310e: 2023-02-13 04:03:38,420 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:38,420 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 04:03:38,427 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/16043ca7727647ddb7a25cf702ef8062, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,429 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/.tmp/f2/2d731bb3e7364830855b671749ac18c4 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/2d731bb3e7364830855b671749ac18c4 2023-02-13 04:03:38,432 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/.tmp/f1/5cadfc43b5ac4a30b2714b029fa0a82d as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/5cadfc43b5ac4a30b2714b029fa0a82d 2023-02-13 04:03:38,432 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/.tmp/f1/e4e35becff5544529c8a6d8fe39d8e6d as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/e4e35becff5544529c8a6d8fe39d8e6d 2023-02-13 04:03:38,438 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/a0a9b8bc0f304826ba9c55931dd5c96a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:03:38,439 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/.tmp/f2/47b89da6c4ce41328cf2e896c3a40cc5 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/47b89da6c4ce41328cf2e896c3a40cc5 2023-02-13 04:03:38,442 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/e4e35becff5544529c8a6d8fe39d8e6d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,444 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/.tmp/f2/3193d93a41fd42aa93da8530b6e07ef0 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/3193d93a41fd42aa93da8530b6e07ef0 2023-02-13 04:03:38,445 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/5cadfc43b5ac4a30b2714b029fa0a82d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,446 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/.tmp/f2/8dab7ad3b509427fabb2ec6cf70ce274 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/8dab7ad3b509427fabb2ec6cf70ce274 2023-02-13 04:03:38,447 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/2d731bb3e7364830855b671749ac18c4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,449 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/47b89da6c4ce41328cf2e896c3a40cc5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:03:38,449 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e6ef3bb677a3d00689bba717531bd7f4 in 183ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:38,450 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e6ef3bb677a3d00689bba717531bd7f4: 2023-02-13 04:03:38,450 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:38,450 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 04:03:38,450 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:38,450 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 5015f186b2add7597cdf44bd360bc815 in 190ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:38,450 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. started... 2023-02-13 04:03:38,450 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5015f186b2add7597cdf44bd360bc815: 2023-02-13 04:03:38,450 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:38,450 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 04:03:38,451 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3c481a2d44e2a4fd155314a0041701f4 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:38,456 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/8dab7ad3b509427fabb2ec6cf70ce274, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,457 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ef40a30f4f57b6d0b3597de97041a459 in 196ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:38,457 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ef40a30f4f57b6d0b3597de97041a459: 2023-02-13 04:03:38,457 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:38,458 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 04:03:38,461 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/.tmp/f1/8241427640f443f9a927736e7b39ff50 2023-02-13 04:03:38,462 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/3193d93a41fd42aa93da8530b6e07ef0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,463 INFO [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cb9464752b5ad5b19e32ab69fb72a292 in 195ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:38,463 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cb9464752b5ad5b19e32ab69fb72a292: 2023-02-13 04:03:38,463 DEBUG [rs(jenkins-hbase4.apache.org,41187,1676261010144)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:38,463 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 04:03:38,463 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 04:03:38,463 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,463 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 04:03:38,464 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41187,1676261010144' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 04:03:38,466 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,466 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:38,476 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/.tmp/f1/c34cda284d964f43ad73e5a3f0644913 2023-02-13 04:03:38,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:38,476 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,476 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:38,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41187,1676261010144' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 04:03:38,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4012c258[Count = 1] remaining members to acquire global barrier 2023-02-13 04:03:38,516 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/.tmp/f2/9990c155b27248a198c744d84ca52a5a 2023-02-13 04:03:38,523 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/.tmp/f1/8241427640f443f9a927736e7b39ff50 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/8241427640f443f9a927736e7b39ff50 2023-02-13 04:03:38,525 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/.tmp/f2/692ed1c7266f4f919a8d6b4a86debe69 2023-02-13 04:03:38,529 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/8241427640f443f9a927736e7b39ff50, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,531 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/.tmp/f2/9990c155b27248a198c744d84ca52a5a as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/9990c155b27248a198c744d84ca52a5a 2023-02-13 04:03:38,531 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/.tmp/f1/c34cda284d964f43ad73e5a3f0644913 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/c34cda284d964f43ad73e5a3f0644913 2023-02-13 04:03:38,537 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/9990c155b27248a198c744d84ca52a5a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,537 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/c34cda284d964f43ad73e5a3f0644913, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,538 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4eb1de542dca16f0a37b4785daf70ae5 in 127ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:38,538 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4eb1de542dca16f0a37b4785daf70ae5: 2023-02-13 04:03:38,538 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:38,538 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 04:03:38,538 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/.tmp/f2/692ed1c7266f4f919a8d6b4a86debe69 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/692ed1c7266f4f919a8d6b4a86debe69 2023-02-13 04:03:38,544 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/692ed1c7266f4f919a8d6b4a86debe69, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:38,545 INFO [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3c481a2d44e2a4fd155314a0041701f4 in 95ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:38,545 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3c481a2d44e2a4fd155314a0041701f4: 2023-02-13 04:03:38,545 DEBUG [rs(jenkins-hbase4.apache.org,35817,1676261010095)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:38,545 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 04:03:38,545 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 04:03:38,545 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,545 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 04:03:38,545 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35817,1676261010095' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 04:03:38,547 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,547 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:38,547 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,547 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:38,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:38,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:38,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:38,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:38,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35817,1676261010095' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 04:03:38,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4012c258[Count = 0] remaining members to acquire global barrier 2023-02-13 04:03:38,550 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 04:03:38,550 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,554 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,554 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,554 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,554 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 04:03:38,554 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 04:03:38,554 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 04:03:38,554 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 04:03:38,554 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41187,1676261010144' in zk 2023-02-13 04:03:38,554 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35817,1676261010095' in zk 2023-02-13 04:03:38,554 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,554 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:03:38,556 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 04:03:38,557 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,557 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:38,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:38,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:38,557 DEBUG [member: 'jenkins-hbase4.apache.org,41187,1676261010144' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 04:03:38,557 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,557 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 04:03:38,558 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:38,558 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1676261010095' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 04:03:38,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:38,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:38,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:38,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,41187,1676261010144': 2023-02-13 04:03:38,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41187,1676261010144' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-13 04:03:38,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:38,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:38,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:38,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:38,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:38,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:38,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:38,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35817,1676261010095': 2023-02-13 04:03:38,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35817,1676261010095' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 04:03:38,566 INFO [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 04:03:38,566 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:03:38,566 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:03:38,566 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 04:03:38,566 INFO [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:03:38,568 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,568 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:38,568 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,568 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:38,568 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:38,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:38,569 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:38,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,569 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:38,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:38,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:38,572 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:38,572 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,579 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,579 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:38,579 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:38,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:38,579 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:38,579 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:38,579 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:38,579 DEBUG [(jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:38,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 04:03:38,579 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:38,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:38,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:38,580 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:38,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:03:38,580 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:38,580 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,580 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:38,580 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:38,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:38,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:38,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:38,580 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:38,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:38,582 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 04:03:38,582 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:03:38,683 DEBUG [Listener at localhost/42775] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:03:38,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:03:38,790 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/hadoop-1949843980066566319.jar 2023-02-13 04:03:38,808 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676261015810 type: FLUSH version: 2 ttl: 0 2023-02-13 04:03:38,809 DEBUG [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce 2023-02-13 04:03:38,809 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(239): region to add: ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(239): region to add: e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(239): region to add: 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(239): region to add: cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(239): region to add: cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(239): region to add: 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(239): region to add: 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(239): region to add: dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(239): region to add: e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(239): region to add: e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(585): clone region=ef40a30f4f57b6d0b3597de97041a459 as ef40a30f4f57b6d0b3597de97041a459 in snapshot testWithMapReduceMultiRegion 2023-02-13 04:03:38,810 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(585): clone region=e6ef3bb677a3d00689bba717531bd7f4 as e6ef3bb677a3d00689bba717531bd7f4 in snapshot testWithMapReduceMultiRegion 2023-02-13 04:03:38,811 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(585): clone region=5015f186b2add7597cdf44bd360bc815 as 5015f186b2add7597cdf44bd360bc815 in snapshot testWithMapReduceMultiRegion 2023-02-13 04:03:38,811 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(585): clone region=cd276396ab5ce2b0b9332f4d4be9f49f as cd276396ab5ce2b0b9332f4d4be9f49f in snapshot testWithMapReduceMultiRegion 2023-02-13 04:03:38,811 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(585): clone region=cb9464752b5ad5b19e32ab69fb72a292 as cb9464752b5ad5b19e32ab69fb72a292 in snapshot testWithMapReduceMultiRegion 2023-02-13 04:03:38,811 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(585): clone region=4eb1de542dca16f0a37b4785daf70ae5 as 4eb1de542dca16f0a37b4785daf70ae5 in snapshot testWithMapReduceMultiRegion 2023-02-13 04:03:38,811 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(585): clone region=3c481a2d44e2a4fd155314a0041701f4 as 3c481a2d44e2a4fd155314a0041701f4 in snapshot testWithMapReduceMultiRegion 2023-02-13 04:03:38,811 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(585): clone region=dc6b2d2002459ad34b0efeeb03100144 as dc6b2d2002459ad34b0efeeb03100144 in snapshot testWithMapReduceMultiRegion 2023-02-13 04:03:38,811 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(585): clone region=e5a407ccfe975eabb2dfab30fc24310e as e5a407ccfe975eabb2dfab30fc24310e in snapshot testWithMapReduceMultiRegion 2023-02-13 04:03:38,811 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(585): clone region=e908bf8c87ab34e33cb35ccd524fbb61 as e908bf8c87ab34e33cb35ccd524fbb61 in snapshot testWithMapReduceMultiRegion 2023-02-13 04:03:38,815 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => cd276396ab5ce2b0b9332f4d4be9f49f, NAME => 'testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,816 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => e6ef3bb677a3d00689bba717531bd7f4, NAME => 'testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,816 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5015f186b2add7597cdf44bd360bc815, NAME => 'testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,817 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => cb9464752b5ad5b19e32ab69fb72a292, NAME => 'testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,817 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => dc6b2d2002459ad34b0efeeb03100144, NAME => 'testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,817 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 3c481a2d44e2a4fd155314a0041701f4, NAME => 'testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,818 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 4eb1de542dca16f0a37b4785daf70ae5, NAME => 'testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,818 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ef40a30f4f57b6d0b3597de97041a459, NAME => 'testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,852 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:38,853 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 70a31ab1db824310b84bbaa3be41788a from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,857 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:38,857 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2074a337e6cd43079feab7be5d5f56d5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,860 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:38,860 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a584a49b66c043f6975255fc463f5558 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,862 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d82f18d0d0ac48ccbaece3b4e89a02a6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,864 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:38,865 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b669d82f8af541d48f0d9d294ced0755 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,871 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6424daf9706a4f3d8cdb393f0f49f2e9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,884 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aa66fc0949fe49d3944ff96ab1bb4594 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,884 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e8f6d199f0bc4a6ab8d6c973a71e5ec0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,892 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing cd276396ab5ce2b0b9332f4d4be9f49f, disabling compactions & flushes 2023-02-13 04:03:38,892 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:38,892 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:38,892 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:38,892 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c79a26db14094bd2b244ef2d17233fd6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,892 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. after waiting 0 ms 2023-02-13 04:03:38,892 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:38,893 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:38,893 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for cd276396ab5ce2b0b9332f4d4be9f49f: Waiting for close lock at 1676261018892Disabling compacts and flushes for region at 1676261018892Disabling writes for close at 1676261018892Writing region close event to WAL at 1676261018892Closed at 1676261018892 2023-02-13 04:03:38,893 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => e5a407ccfe975eabb2dfab30fc24310e, NAME => 'testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,900 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:38,900 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 46ea15019f5a49d2bd557d03933bfdc6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,908 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1f9f0c956b1a444eb93b15bb36d7a774 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,908 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:38,909 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0b8d656a03604c5d8e8e2b3e85831375 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,911 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 852a27b6b2cf40cc98ac1d146b896045 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,912 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 5015f186b2add7597cdf44bd360bc815, disabling compactions & flushes 2023-02-13 04:03:38,912 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:38,912 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:38,912 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. after waiting 0 ms 2023-02-13 04:03:38,912 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:38,912 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:38,912 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 5015f186b2add7597cdf44bd360bc815: Waiting for close lock at 1676261018911Disabling compacts and flushes for region at 1676261018911Disabling writes for close at 1676261018912 (+1 ms)Writing region close event to WAL at 1676261018912Closed at 1676261018912 2023-02-13 04:03:38,912 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => e908bf8c87ab34e33cb35ccd524fbb61, NAME => 'testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,920 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:38,920 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 93fccdfb380d4b7cbabd416a61739a4f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 3c481a2d44e2a4fd155314a0041701f4, disabling compactions & flushes 2023-02-13 04:03:38,921 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 4eb1de542dca16f0a37b4785daf70ae5, disabling compactions & flushes 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:38,921 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. after waiting 0 ms 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ef40a30f4f57b6d0b3597de97041a459, disabling compactions & flushes 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. after waiting 0 ms 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:38,921 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:38,921 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 4eb1de542dca16f0a37b4785daf70ae5: Waiting for close lock at 1676261018921Disabling compacts and flushes for region at 1676261018921Disabling writes for close at 1676261018921Writing region close event to WAL at 1676261018921Closed at 1676261018921 2023-02-13 04:03:38,921 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:38,921 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. after waiting 0 ms 2023-02-13 04:03:38,922 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 3c481a2d44e2a4fd155314a0041701f4: Waiting for close lock at 1676261018921Disabling compacts and flushes for region at 1676261018921Disabling writes for close at 1676261018921Writing region close event to WAL at 1676261018921Closed at 1676261018921 2023-02-13 04:03:38,922 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:38,922 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:38,922 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ef40a30f4f57b6d0b3597de97041a459: Waiting for close lock at 1676261018921Disabling compacts and flushes for region at 1676261018921Disabling writes for close at 1676261018922 (+1 ms)Writing region close event to WAL at 1676261018922Closed at 1676261018922 2023-02-13 04:03:38,924 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing cb9464752b5ad5b19e32ab69fb72a292, disabling compactions & flushes 2023-02-13 04:03:38,924 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8002dc76e27845a198093849bb0b2572 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,924 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:38,924 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:38,924 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. after waiting 0 ms 2023-02-13 04:03:38,924 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:38,924 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:38,924 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for cb9464752b5ad5b19e32ab69fb72a292: Waiting for close lock at 1676261018924Disabling compacts and flushes for region at 1676261018924Disabling writes for close at 1676261018924Writing region close event to WAL at 1676261018924Closed at 1676261018924 2023-02-13 04:03:38,925 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a911c1bd23b44b98b5ce87b1fa6d5f42 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 04:03:38,928 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing e6ef3bb677a3d00689bba717531bd7f4, disabling compactions & flushes 2023-02-13 04:03:38,929 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:38,929 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:38,929 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. after waiting 0 ms 2023-02-13 04:03:38,929 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:38,929 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing dc6b2d2002459ad34b0efeeb03100144, disabling compactions & flushes 2023-02-13 04:03:38,929 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:38,929 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:38,929 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for e6ef3bb677a3d00689bba717531bd7f4: Waiting for close lock at 1676261018928Disabling compacts and flushes for region at 1676261018928Disabling writes for close at 1676261018929 (+1 ms)Writing region close event to WAL at 1676261018929Closed at 1676261018929 2023-02-13 04:03:38,929 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:38,929 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. after waiting 0 ms 2023-02-13 04:03:38,929 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:38,929 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:38,929 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for dc6b2d2002459ad34b0efeeb03100144: Waiting for close lock at 1676261018929Disabling compacts and flushes for region at 1676261018929Disabling writes for close at 1676261018929Writing region close event to WAL at 1676261018929Closed at 1676261018929 2023-02-13 04:03:38,931 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:38,931 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing e5a407ccfe975eabb2dfab30fc24310e, disabling compactions & flushes 2023-02-13 04:03:38,931 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:38,931 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:38,931 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. after waiting 0 ms 2023-02-13 04:03:38,931 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:38,931 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:38,931 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for e5a407ccfe975eabb2dfab30fc24310e: Waiting for close lock at 1676261018931Disabling compacts and flushes for region at 1676261018931Disabling writes for close at 1676261018931Writing region close event to WAL at 1676261018931Closed at 1676261018931 2023-02-13 04:03:38,934 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:38,934 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing e908bf8c87ab34e33cb35ccd524fbb61, disabling compactions & flushes 2023-02-13 04:03:38,934 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:38,934 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:38,934 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. after waiting 0 ms 2023-02-13 04:03:38,934 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:38,934 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:38,934 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for e908bf8c87ab34e33cb35ccd524fbb61: Waiting for close lock at 1676261018934Disabling compacts and flushes for region at 1676261018934Disabling writes for close at 1676261018934Writing region close event to WAL at 1676261018934Closed at 1676261018934 2023-02-13 04:03:38,934 INFO [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676261015810 type: FLUSH version: 2 ttl: 0 2023-02-13 04:03:38,935 DEBUG [Listener at localhost/42775] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,935 DEBUG [Listener at localhost/42775] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429 2023-02-13 04:03:38,936 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-data/ 2023-02-13 04:03:38,936 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----default/ 2023-02-13 04:03:38,937 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 04:03:38,938 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----------3c481a2d44e2a4fd155314a0041701f4/ 2023-02-13 04:03:38,938 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:38,938 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:38,939 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=3c481a2d44e2a4fd155314a0041701f4-c79a26db14094bd2b244ef2d17233fd6 2023-02-13 04:03:38,939 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:38,940 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=3c481a2d44e2a4fd155314a0041701f4-1f9f0c956b1a444eb93b15bb36d7a774 2023-02-13 04:03:38,940 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----------4eb1de542dca16f0a37b4785daf70ae5/ 2023-02-13 04:03:38,940 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:38,940 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:38,941 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=4eb1de542dca16f0a37b4785daf70ae5-b669d82f8af541d48f0d9d294ced0755 2023-02-13 04:03:38,941 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:38,942 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=4eb1de542dca16f0a37b4785daf70ae5-aa66fc0949fe49d3944ff96ab1bb4594 2023-02-13 04:03:38,942 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----------5015f186b2add7597cdf44bd360bc815/ 2023-02-13 04:03:38,942 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:38,943 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:38,943 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=5015f186b2add7597cdf44bd360bc815-a584a49b66c043f6975255fc463f5558 2023-02-13 04:03:38,943 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:38,944 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=5015f186b2add7597cdf44bd360bc815-6424daf9706a4f3d8cdb393f0f49f2e9 2023-02-13 04:03:38,944 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----------cb9464752b5ad5b19e32ab69fb72a292/ 2023-02-13 04:03:38,944 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:38,945 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:38,945 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=cb9464752b5ad5b19e32ab69fb72a292-70a31ab1db824310b84bbaa3be41788a 2023-02-13 04:03:38,945 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:38,946 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=cb9464752b5ad5b19e32ab69fb72a292-e8f6d199f0bc4a6ab8d6c973a71e5ec0 2023-02-13 04:03:38,946 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----------cd276396ab5ce2b0b9332f4d4be9f49f/ 2023-02-13 04:03:38,946 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:38,946 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:38,947 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=cd276396ab5ce2b0b9332f4d4be9f49f-2074a337e6cd43079feab7be5d5f56d5 2023-02-13 04:03:38,947 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:38,948 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=cd276396ab5ce2b0b9332f4d4be9f49f-d82f18d0d0ac48ccbaece3b4e89a02a6 2023-02-13 04:03:38,948 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----------dc6b2d2002459ad34b0efeeb03100144/ 2023-02-13 04:03:38,948 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:38,948 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:38,949 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=dc6b2d2002459ad34b0efeeb03100144-0b8d656a03604c5d8e8e2b3e85831375 2023-02-13 04:03:38,949 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:38,950 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=dc6b2d2002459ad34b0efeeb03100144-8002dc76e27845a198093849bb0b2572 2023-02-13 04:03:38,950 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----------e5a407ccfe975eabb2dfab30fc24310e/ 2023-02-13 04:03:38,950 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:38,950 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----------e6ef3bb677a3d00689bba717531bd7f4/ 2023-02-13 04:03:38,951 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:38,951 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:38,952 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=e6ef3bb677a3d00689bba717531bd7f4-93fccdfb380d4b7cbabd416a61739a4f 2023-02-13 04:03:38,952 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:38,952 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=e6ef3bb677a3d00689bba717531bd7f4-a911c1bd23b44b98b5ce87b1fa6d5f42 2023-02-13 04:03:38,952 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----------e908bf8c87ab34e33cb35ccd524fbb61/ 2023-02-13 04:03:38,953 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:38,953 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |----------ef40a30f4f57b6d0b3597de97041a459/ 2023-02-13 04:03:38,954 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:38,954 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:38,954 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=ef40a30f4f57b6d0b3597de97041a459-46ea15019f5a49d2bd557d03933bfdc6 2023-02-13 04:03:38,954 DEBUG [Listener at localhost/42775] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:38,955 DEBUG [Listener at localhost/42775] util.CommonFSUtils(702): |----------------testWithMapReduce=ef40a30f4f57b6d0b3597de97041a459-852a27b6b2cf40cc98ac1d146b896045 2023-02-13 04:03:38,964 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:38,964 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:38,965 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:38,965 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:38,965 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:38,966 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:38,966 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:39,042 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/hadoop-1219661768069585970.jar 2023-02-13 04:03:39,043 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 04:03:39,043 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:39,043 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:39,043 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 04:03:39,043 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:39,044 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:39,044 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:39,045 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:39,045 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 04:03:39,045 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 04:03:39,046 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 04:03:39,046 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 04:03:39,047 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 04:03:39,047 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 04:03:39,048 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 04:03:39,048 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 04:03:39,048 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 04:03:39,049 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 04:03:39,054 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:39,054 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 04:03:39,055 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 04:03:39,055 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 04:03:39,055 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 04:03:39,123 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/hadoop-3338061132840865544.jar 2023-02-13 04:03:39,124 DEBUG [Listener at localhost/42775] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 04:03:39,177 WARN [Listener at localhost/42775] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 04:03:39,238 INFO [Listener at localhost/42775] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 04:03:39,631 WARN [Listener at localhost/42775] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/mapreduce.cluster.local.dir/1676261019540/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 04:03:39,631 WARN [Listener at localhost/42775] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/mapreduce.cluster.local.dir/1676261019540/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 04:03:39,772 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:39,772 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:39,774 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:39,776 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:39,777 DEBUG [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1 2023-02-13 04:03:39,778 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c481a2d44e2a4fd155314a0041701f4 columnFamilyName f1 2023-02-13 04:03:39,787 DEBUG [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/testWithMapReduce=3c481a2d44e2a4fd155314a0041701f4-c79a26db14094bd2b244ef2d17233fd6 2023-02-13 04:03:39,788 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] regionserver.HStore(310): Store=3c481a2d44e2a4fd155314a0041701f4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:39,788 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:39,789 DEBUG [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2 2023-02-13 04:03:39,790 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c481a2d44e2a4fd155314a0041701f4 columnFamilyName f2 2023-02-13 04:03:39,796 DEBUG [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/testWithMapReduce=3c481a2d44e2a4fd155314a0041701f4-1f9f0c956b1a444eb93b15bb36d7a774 2023-02-13 04:03:39,796 INFO [StoreOpener-3c481a2d44e2a4fd155314a0041701f4-1] regionserver.HStore(310): Store=3c481a2d44e2a4fd155314a0041701f4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:39,796 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:39,796 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3c481a2d44e2a4fd155314a0041701f4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58907502, jitterRate=-0.1222098171710968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:39,796 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3c481a2d44e2a4fd155314a0041701f4: Writing region info on filesystem at 1676261019774Initializing all the Stores at 1676261019775 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261019775Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261019775Region opened successfully at 1676261019796 (+21 ms) 2023-02-13 04:03:39,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3c481a2d44e2a4fd155314a0041701f4, disabling compactions & flushes 2023-02-13 04:03:39,964 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:39,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:39,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. after waiting 0 ms 2023-02-13 04:03:39,965 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:39,969 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:39,969 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3c481a2d44e2a4fd155314a0041701f4: Waiting for close lock at 1676261019964Disabling compacts and flushes for region at 1676261019964Disabling writes for close at 1676261019965 (+1 ms)Writing region close event to WAL at 1676261019969 (+4 ms)Closed at 1676261019969 2023-02-13 04:03:39,981 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:39,981 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:39,982 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:39,985 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:39,987 DEBUG [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/f1 2023-02-13 04:03:39,987 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5a407ccfe975eabb2dfab30fc24310e columnFamilyName f1 2023-02-13 04:03:39,988 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] regionserver.HStore(310): Store=e5a407ccfe975eabb2dfab30fc24310e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:39,988 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:39,990 DEBUG [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/f2 2023-02-13 04:03:39,990 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5a407ccfe975eabb2dfab30fc24310e columnFamilyName f2 2023-02-13 04:03:39,991 INFO [StoreOpener-e5a407ccfe975eabb2dfab30fc24310e-1] regionserver.HStore(310): Store=e5a407ccfe975eabb2dfab30fc24310e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:39,992 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:39,992 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e5a407ccfe975eabb2dfab30fc24310e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66487455, jitterRate=-0.009259715676307678}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:39,992 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e5a407ccfe975eabb2dfab30fc24310e: Writing region info on filesystem at 1676261019982Initializing all the Stores at 1676261019984 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261019984Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261019984Region opened successfully at 1676261019992 (+8 ms) 2023-02-13 04:03:40,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e5a407ccfe975eabb2dfab30fc24310e, disabling compactions & flushes 2023-02-13 04:03:40,011 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:40,012 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:40,012 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. after waiting 0 ms 2023-02-13 04:03:40,012 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:40,012 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:40,012 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e5a407ccfe975eabb2dfab30fc24310e: Waiting for close lock at 1676261020011Disabling compacts and flushes for region at 1676261020011Disabling writes for close at 1676261020012 (+1 ms)Writing region close event to WAL at 1676261020012Closed at 1676261020012 2023-02-13 04:03:40,019 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:40,019 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:40,021 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:40,023 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:40,025 DEBUG [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1 2023-02-13 04:03:40,025 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd276396ab5ce2b0b9332f4d4be9f49f columnFamilyName f1 2023-02-13 04:03:40,032 DEBUG [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/testWithMapReduce=cd276396ab5ce2b0b9332f4d4be9f49f-2074a337e6cd43079feab7be5d5f56d5 2023-02-13 04:03:40,032 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] regionserver.HStore(310): Store=cd276396ab5ce2b0b9332f4d4be9f49f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,032 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:40,033 DEBUG [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2 2023-02-13 04:03:40,034 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd276396ab5ce2b0b9332f4d4be9f49f columnFamilyName f2 2023-02-13 04:03:40,041 DEBUG [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/testWithMapReduce=cd276396ab5ce2b0b9332f4d4be9f49f-d82f18d0d0ac48ccbaece3b4e89a02a6 2023-02-13 04:03:40,041 INFO [StoreOpener-cd276396ab5ce2b0b9332f4d4be9f49f-1] regionserver.HStore(310): Store=cd276396ab5ce2b0b9332f4d4be9f49f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,041 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:40,041 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cd276396ab5ce2b0b9332f4d4be9f49f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72091609, jitterRate=0.07424868643283844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:40,041 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cd276396ab5ce2b0b9332f4d4be9f49f: Writing region info on filesystem at 1676261020021Initializing all the Stores at 1676261020023 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020023Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020023Region opened successfully at 1676261020041 (+18 ms) 2023-02-13 04:03:40,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cd276396ab5ce2b0b9332f4d4be9f49f, disabling compactions & flushes 2023-02-13 04:03:40,098 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:40,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:40,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. after waiting 0 ms 2023-02-13 04:03:40,098 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:40,101 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:40,101 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cd276396ab5ce2b0b9332f4d4be9f49f: Waiting for close lock at 1676261020098Disabling compacts and flushes for region at 1676261020098Disabling writes for close at 1676261020098Writing region close event to WAL at 1676261020101 (+3 ms)Closed at 1676261020101 2023-02-13 04:03:40,107 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:40,108 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:40,110 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:40,113 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:40,115 DEBUG [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/f1 2023-02-13 04:03:40,115 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e908bf8c87ab34e33cb35ccd524fbb61 columnFamilyName f1 2023-02-13 04:03:40,116 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] regionserver.HStore(310): Store=e908bf8c87ab34e33cb35ccd524fbb61/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,116 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:40,118 DEBUG [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/f2 2023-02-13 04:03:40,119 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e908bf8c87ab34e33cb35ccd524fbb61 columnFamilyName f2 2023-02-13 04:03:40,119 INFO [StoreOpener-e908bf8c87ab34e33cb35ccd524fbb61-1] regionserver.HStore(310): Store=e908bf8c87ab34e33cb35ccd524fbb61/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,120 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:40,120 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e908bf8c87ab34e33cb35ccd524fbb61; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64885926, jitterRate=-0.03312435746192932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:40,120 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e908bf8c87ab34e33cb35ccd524fbb61: Writing region info on filesystem at 1676261020110Initializing all the Stores at 1676261020112 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020112Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020112Region opened successfully at 1676261020120 (+8 ms) 2023-02-13 04:03:40,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e908bf8c87ab34e33cb35ccd524fbb61, disabling compactions & flushes 2023-02-13 04:03:40,162 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:40,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:40,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. after waiting 0 ms 2023-02-13 04:03:40,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:40,163 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:40,163 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e908bf8c87ab34e33cb35ccd524fbb61: Waiting for close lock at 1676261020162Disabling compacts and flushes for region at 1676261020162Disabling writes for close at 1676261020162Writing region close event to WAL at 1676261020163 (+1 ms)Closed at 1676261020163 2023-02-13 04:03:40,168 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:40,168 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:40,172 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:40,176 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:40,178 DEBUG [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1 2023-02-13 04:03:40,178 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5015f186b2add7597cdf44bd360bc815 columnFamilyName f1 2023-02-13 04:03:40,186 DEBUG [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/testWithMapReduce=5015f186b2add7597cdf44bd360bc815-a584a49b66c043f6975255fc463f5558 2023-02-13 04:03:40,186 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] regionserver.HStore(310): Store=5015f186b2add7597cdf44bd360bc815/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,186 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:40,187 DEBUG [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2 2023-02-13 04:03:40,188 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5015f186b2add7597cdf44bd360bc815 columnFamilyName f2 2023-02-13 04:03:40,198 DEBUG [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/testWithMapReduce=5015f186b2add7597cdf44bd360bc815-6424daf9706a4f3d8cdb393f0f49f2e9 2023-02-13 04:03:40,198 INFO [StoreOpener-5015f186b2add7597cdf44bd360bc815-1] regionserver.HStore(310): Store=5015f186b2add7597cdf44bd360bc815/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,199 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:40,199 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5015f186b2add7597cdf44bd360bc815; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64125580, jitterRate=-0.04445439577102661}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:40,199 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5015f186b2add7597cdf44bd360bc815: Writing region info on filesystem at 1676261020172Initializing all the Stores at 1676261020173 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020173Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020175 (+2 ms)Region opened successfully at 1676261020199 (+24 ms) 2023-02-13 04:03:40,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5015f186b2add7597cdf44bd360bc815, disabling compactions & flushes 2023-02-13 04:03:40,252 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:40,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:40,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. after waiting 0 ms 2023-02-13 04:03:40,252 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:40,255 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:40,255 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5015f186b2add7597cdf44bd360bc815: Waiting for close lock at 1676261020252Disabling compacts and flushes for region at 1676261020252Disabling writes for close at 1676261020252Writing region close event to WAL at 1676261020255 (+3 ms)Closed at 1676261020255 2023-02-13 04:03:40,262 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:40,262 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:40,267 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:40,269 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:40,271 DEBUG [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1 2023-02-13 04:03:40,271 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb9464752b5ad5b19e32ab69fb72a292 columnFamilyName f1 2023-02-13 04:03:40,278 DEBUG [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/testWithMapReduce=cb9464752b5ad5b19e32ab69fb72a292-70a31ab1db824310b84bbaa3be41788a 2023-02-13 04:03:40,278 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] regionserver.HStore(310): Store=cb9464752b5ad5b19e32ab69fb72a292/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,278 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:40,280 DEBUG [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2 2023-02-13 04:03:40,280 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb9464752b5ad5b19e32ab69fb72a292 columnFamilyName f2 2023-02-13 04:03:40,287 DEBUG [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/testWithMapReduce=cb9464752b5ad5b19e32ab69fb72a292-e8f6d199f0bc4a6ab8d6c973a71e5ec0 2023-02-13 04:03:40,287 INFO [StoreOpener-cb9464752b5ad5b19e32ab69fb72a292-1] regionserver.HStore(310): Store=cb9464752b5ad5b19e32ab69fb72a292/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:40,287 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cb9464752b5ad5b19e32ab69fb72a292; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68128110, jitterRate=0.015187948942184448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:40,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cb9464752b5ad5b19e32ab69fb72a292: Writing region info on filesystem at 1676261020267Initializing all the Stores at 1676261020268 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020268Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020269 (+1 ms)Region opened successfully at 1676261020288 (+19 ms) 2023-02-13 04:03:40,320 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cb9464752b5ad5b19e32ab69fb72a292, disabling compactions & flushes 2023-02-13 04:03:40,320 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:40,320 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:40,320 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. after waiting 0 ms 2023-02-13 04:03:40,320 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:40,323 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:40,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cb9464752b5ad5b19e32ab69fb72a292: Waiting for close lock at 1676261020320Disabling compacts and flushes for region at 1676261020320Disabling writes for close at 1676261020320Writing region close event to WAL at 1676261020323 (+3 ms)Closed at 1676261020323 2023-02-13 04:03:40,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:40,328 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:40,329 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:40,331 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:40,332 DEBUG [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1 2023-02-13 04:03:40,332 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4eb1de542dca16f0a37b4785daf70ae5 columnFamilyName f1 2023-02-13 04:03:40,342 DEBUG [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/testWithMapReduce=4eb1de542dca16f0a37b4785daf70ae5-b669d82f8af541d48f0d9d294ced0755 2023-02-13 04:03:40,342 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] regionserver.HStore(310): Store=4eb1de542dca16f0a37b4785daf70ae5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,342 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:40,344 DEBUG [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2 2023-02-13 04:03:40,344 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4eb1de542dca16f0a37b4785daf70ae5 columnFamilyName f2 2023-02-13 04:03:40,366 DEBUG [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/testWithMapReduce=4eb1de542dca16f0a37b4785daf70ae5-aa66fc0949fe49d3944ff96ab1bb4594 2023-02-13 04:03:40,366 INFO [StoreOpener-4eb1de542dca16f0a37b4785daf70ae5-1] regionserver.HStore(310): Store=4eb1de542dca16f0a37b4785daf70ae5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,366 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:40,366 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4eb1de542dca16f0a37b4785daf70ae5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72195820, jitterRate=0.0758015513420105}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:40,367 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4eb1de542dca16f0a37b4785daf70ae5: Writing region info on filesystem at 1676261020329Initializing all the Stores at 1676261020330 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020330Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020330Region opened successfully at 1676261020367 (+37 ms) 2023-02-13 04:03:40,402 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4eb1de542dca16f0a37b4785daf70ae5, disabling compactions & flushes 2023-02-13 04:03:40,402 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:40,402 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:40,402 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. after waiting 0 ms 2023-02-13 04:03:40,402 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:40,417 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:40,417 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4eb1de542dca16f0a37b4785daf70ae5: Waiting for close lock at 1676261020402Disabling compacts and flushes for region at 1676261020402Disabling writes for close at 1676261020402Writing region close event to WAL at 1676261020417 (+15 ms)Closed at 1676261020417 2023-02-13 04:03:40,424 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:40,424 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:40,427 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:40,430 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:40,432 DEBUG [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1 2023-02-13 04:03:40,432 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef40a30f4f57b6d0b3597de97041a459 columnFamilyName f1 2023-02-13 04:03:40,439 DEBUG [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/testWithMapReduce=ef40a30f4f57b6d0b3597de97041a459-46ea15019f5a49d2bd557d03933bfdc6 2023-02-13 04:03:40,439 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] regionserver.HStore(310): Store=ef40a30f4f57b6d0b3597de97041a459/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,440 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:40,441 DEBUG [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2 2023-02-13 04:03:40,441 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef40a30f4f57b6d0b3597de97041a459 columnFamilyName f2 2023-02-13 04:03:40,447 DEBUG [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/testWithMapReduce=ef40a30f4f57b6d0b3597de97041a459-852a27b6b2cf40cc98ac1d146b896045 2023-02-13 04:03:40,447 INFO [StoreOpener-ef40a30f4f57b6d0b3597de97041a459-1] regionserver.HStore(310): Store=ef40a30f4f57b6d0b3597de97041a459/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,448 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:40,448 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ef40a30f4f57b6d0b3597de97041a459; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72564059, jitterRate=0.08128874003887177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:40,448 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ef40a30f4f57b6d0b3597de97041a459: Writing region info on filesystem at 1676261020427Initializing all the Stores at 1676261020428 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020428Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020430 (+2 ms)Region opened successfully at 1676261020448 (+18 ms) 2023-02-13 04:03:40,499 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ef40a30f4f57b6d0b3597de97041a459, disabling compactions & flushes 2023-02-13 04:03:40,499 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:40,499 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:40,499 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. after waiting 0 ms 2023-02-13 04:03:40,499 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:40,502 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:40,503 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ef40a30f4f57b6d0b3597de97041a459: Waiting for close lock at 1676261020499Disabling compacts and flushes for region at 1676261020499Disabling writes for close at 1676261020499Writing region close event to WAL at 1676261020502 (+3 ms)Closed at 1676261020502 2023-02-13 04:03:40,507 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:40,507 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:40,509 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:40,511 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:40,512 DEBUG [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1 2023-02-13 04:03:40,512 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc6b2d2002459ad34b0efeeb03100144 columnFamilyName f1 2023-02-13 04:03:40,522 DEBUG [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/testWithMapReduce=dc6b2d2002459ad34b0efeeb03100144-0b8d656a03604c5d8e8e2b3e85831375 2023-02-13 04:03:40,522 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] regionserver.HStore(310): Store=dc6b2d2002459ad34b0efeeb03100144/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,522 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:40,523 DEBUG [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2 2023-02-13 04:03:40,524 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc6b2d2002459ad34b0efeeb03100144 columnFamilyName f2 2023-02-13 04:03:40,531 DEBUG [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/testWithMapReduce=dc6b2d2002459ad34b0efeeb03100144-8002dc76e27845a198093849bb0b2572 2023-02-13 04:03:40,531 INFO [StoreOpener-dc6b2d2002459ad34b0efeeb03100144-1] regionserver.HStore(310): Store=dc6b2d2002459ad34b0efeeb03100144/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,532 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:40,532 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dc6b2d2002459ad34b0efeeb03100144; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72370087, jitterRate=0.07839833199977875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:40,532 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dc6b2d2002459ad34b0efeeb03100144: Writing region info on filesystem at 1676261020509Initializing all the Stores at 1676261020510 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020510Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020510Region opened successfully at 1676261020532 (+22 ms) 2023-02-13 04:03:40,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dc6b2d2002459ad34b0efeeb03100144, disabling compactions & flushes 2023-02-13 04:03:40,565 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:40,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:40,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. after waiting 0 ms 2023-02-13 04:03:40,565 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:40,568 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:40,568 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dc6b2d2002459ad34b0efeeb03100144: Waiting for close lock at 1676261020565Disabling compacts and flushes for region at 1676261020565Disabling writes for close at 1676261020565Writing region close event to WAL at 1676261020568 (+3 ms)Closed at 1676261020568 2023-02-13 04:03:40,571 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:40,571 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:40,572 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:40,574 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:40,575 DEBUG [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1 2023-02-13 04:03:40,575 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6ef3bb677a3d00689bba717531bd7f4 columnFamilyName f1 2023-02-13 04:03:40,581 DEBUG [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/testWithMapReduce=e6ef3bb677a3d00689bba717531bd7f4-93fccdfb380d4b7cbabd416a61739a4f 2023-02-13 04:03:40,581 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] regionserver.HStore(310): Store=e6ef3bb677a3d00689bba717531bd7f4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,581 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:40,585 DEBUG [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2 2023-02-13 04:03:40,585 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6ef3bb677a3d00689bba717531bd7f4 columnFamilyName f2 2023-02-13 04:03:40,590 DEBUG [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] regionserver.HStore(539): loaded hdfs://localhost:33353/user/jenkins/test-data/43c6e5b8-b7eb-1b29-a94a-bc682b13d2cd/testWithMapReduceMultiRegion/75207612-5d66-4778-81f3-4e9421340429/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/testWithMapReduce=e6ef3bb677a3d00689bba717531bd7f4-a911c1bd23b44b98b5ce87b1fa6d5f42 2023-02-13 04:03:40,591 INFO [StoreOpener-e6ef3bb677a3d00689bba717531bd7f4-1] regionserver.HStore(310): Store=e6ef3bb677a3d00689bba717531bd7f4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:40,591 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:40,591 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e6ef3bb677a3d00689bba717531bd7f4; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73780272, jitterRate=0.0994117259979248}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:40,591 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e6ef3bb677a3d00689bba717531bd7f4: Writing region info on filesystem at 1676261020572Initializing all the Stores at 1676261020573 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020573Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261020573Region opened successfully at 1676261020591 (+18 ms) 2023-02-13 04:03:40,620 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e6ef3bb677a3d00689bba717531bd7f4, disabling compactions & flushes 2023-02-13 04:03:40,620 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:40,620 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:40,620 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. after waiting 0 ms 2023-02-13 04:03:40,620 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:40,623 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:40,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e6ef3bb677a3d00689bba717531bd7f4: Waiting for close lock at 1676261020620Disabling compacts and flushes for region at 1676261020620Disabling writes for close at 1676261020620Writing region close event to WAL at 1676261020623 (+3 ms)Closed at 1676261020623 2023-02-13 04:03:41,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-13 04:03:41,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-13 04:03:41,709 INFO [Listener at localhost/42775] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 04:03:41,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 04:03:41,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-13 04:03:41,720 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261021720"}]},"ts":"1676261021720"} 2023-02-13 04:03:41,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 04:03:41,722 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-13 04:03:41,724 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-13 04:03:41,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e908bf8c87ab34e33cb35ccd524fbb61, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5015f186b2add7597cdf44bd360bc815, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e6ef3bb677a3d00689bba717531bd7f4, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4eb1de542dca16f0a37b4785daf70ae5, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cb9464752b5ad5b19e32ab69fb72a292, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ef40a30f4f57b6d0b3597de97041a459, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cd276396ab5ce2b0b9332f4d4be9f49f, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3c481a2d44e2a4fd155314a0041701f4, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dc6b2d2002459ad34b0efeeb03100144, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e5a407ccfe975eabb2dfab30fc24310e, UNASSIGN}] 2023-02-13 04:03:41,730 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cb9464752b5ad5b19e32ab69fb72a292, UNASSIGN 2023-02-13 04:03:41,730 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e6ef3bb677a3d00689bba717531bd7f4, UNASSIGN 2023-02-13 04:03:41,731 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ef40a30f4f57b6d0b3597de97041a459, UNASSIGN 2023-02-13 04:03:41,731 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4eb1de542dca16f0a37b4785daf70ae5, UNASSIGN 2023-02-13 04:03:41,731 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e5a407ccfe975eabb2dfab30fc24310e, UNASSIGN 2023-02-13 04:03:41,732 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e6ef3bb677a3d00689bba717531bd7f4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:41,732 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=4eb1de542dca16f0a37b4785daf70ae5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:41,732 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261021732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261021732"}]},"ts":"1676261021732"} 2023-02-13 04:03:41,732 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=ef40a30f4f57b6d0b3597de97041a459, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:41,732 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cb9464752b5ad5b19e32ab69fb72a292, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:41,732 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261021732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261021732"}]},"ts":"1676261021732"} 2023-02-13 04:03:41,732 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261021732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261021732"}]},"ts":"1676261021732"} 2023-02-13 04:03:41,732 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e5a407ccfe975eabb2dfab30fc24310e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:41,732 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261021732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261021732"}]},"ts":"1676261021732"} 2023-02-13 04:03:41,733 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261021732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261021732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261021732"}]},"ts":"1676261021732"} 2023-02-13 04:03:41,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure e6ef3bb677a3d00689bba717531bd7f4, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:41,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=37, state=RUNNABLE; CloseRegionProcedure 4eb1de542dca16f0a37b4785daf70ae5, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:41,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=38, state=RUNNABLE; CloseRegionProcedure cb9464752b5ad5b19e32ab69fb72a292, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:41,739 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=39, state=RUNNABLE; CloseRegionProcedure ef40a30f4f57b6d0b3597de97041a459, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:41,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure e5a407ccfe975eabb2dfab30fc24310e, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:41,746 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=dc6b2d2002459ad34b0efeeb03100144, UNASSIGN 2023-02-13 04:03:41,746 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3c481a2d44e2a4fd155314a0041701f4, UNASSIGN 2023-02-13 04:03:41,747 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3c481a2d44e2a4fd155314a0041701f4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:41,747 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261021747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261021747"}]},"ts":"1676261021747"} 2023-02-13 04:03:41,748 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cd276396ab5ce2b0b9332f4d4be9f49f, UNASSIGN 2023-02-13 04:03:41,748 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5015f186b2add7597cdf44bd360bc815, UNASSIGN 2023-02-13 04:03:41,748 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e908bf8c87ab34e33cb35ccd524fbb61, UNASSIGN 2023-02-13 04:03:41,749 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=dc6b2d2002459ad34b0efeeb03100144, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:41,749 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=cd276396ab5ce2b0b9332f4d4be9f49f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:41,749 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021749"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261021749"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261021749"}]},"ts":"1676261021749"} 2023-02-13 04:03:41,749 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021749"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261021749"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261021749"}]},"ts":"1676261021749"} 2023-02-13 04:03:41,750 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=41, state=RUNNABLE; CloseRegionProcedure 3c481a2d44e2a4fd155314a0041701f4, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:41,750 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=5015f186b2add7597cdf44bd360bc815, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:41,750 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=e908bf8c87ab34e33cb35ccd524fbb61, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:41,750 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021750"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261021750"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261021750"}]},"ts":"1676261021750"} 2023-02-13 04:03:41,750 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261021750"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261021750"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261021750"}]},"ts":"1676261021750"} 2023-02-13 04:03:41,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=42, state=RUNNABLE; CloseRegionProcedure dc6b2d2002459ad34b0efeeb03100144, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:41,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure cd276396ab5ce2b0b9332f4d4be9f49f, server=jenkins-hbase4.apache.org,35817,1676261010095}] 2023-02-13 04:03:41,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=34, state=RUNNABLE; CloseRegionProcedure e908bf8c87ab34e33cb35ccd524fbb61, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:41,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=35, state=RUNNABLE; CloseRegionProcedure 5015f186b2add7597cdf44bd360bc815, server=jenkins-hbase4.apache.org,41187,1676261010144}] 2023-02-13 04:03:41,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 04:03:41,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:41,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:41,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4eb1de542dca16f0a37b4785daf70ae5, disabling compactions & flushes 2023-02-13 04:03:41,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cb9464752b5ad5b19e32ab69fb72a292, disabling compactions & flushes 2023-02-13 04:03:41,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:41,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:41,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. after waiting 0 ms 2023-02-13 04:03:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. after waiting 0 ms 2023-02-13 04:03:41,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:41,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:41,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5. 2023-02-13 04:03:41,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4eb1de542dca16f0a37b4785daf70ae5: Waiting for close lock at 1676261021898Running coprocessor pre-close hooks at 1676261021898Disabling compacts and flushes for region at 1676261021898Disabling writes for close at 1676261021899 (+1 ms)Writing region close event to WAL at 1676261021918 (+19 ms)Running coprocessor post-close hooks at 1676261021923 (+5 ms)Closed at 1676261021923 2023-02-13 04:03:41,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:41,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:41,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:41,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e6ef3bb677a3d00689bba717531bd7f4, disabling compactions & flushes 2023-02-13 04:03:41,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:41,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:41,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292. 2023-02-13 04:03:41,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. after waiting 0 ms 2023-02-13 04:03:41,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:41,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cb9464752b5ad5b19e32ab69fb72a292: Waiting for close lock at 1676261021898Running coprocessor pre-close hooks at 1676261021898Disabling compacts and flushes for region at 1676261021898Disabling writes for close at 1676261021899 (+1 ms)Writing region close event to WAL at 1676261021918 (+19 ms)Running coprocessor post-close hooks at 1676261021926 (+8 ms)Closed at 1676261021927 (+1 ms) 2023-02-13 04:03:41,927 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=4eb1de542dca16f0a37b4785daf70ae5, regionState=CLOSED 2023-02-13 04:03:41,927 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021927"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261021927"}]},"ts":"1676261021927"} 2023-02-13 04:03:41,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:41,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:41,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e5a407ccfe975eabb2dfab30fc24310e, disabling compactions & flushes 2023-02-13 04:03:41,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:41,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:41,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. after waiting 0 ms 2023-02-13 04:03:41,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:41,931 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cb9464752b5ad5b19e32ab69fb72a292, regionState=CLOSED 2023-02-13 04:03:41,931 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261021931"}]},"ts":"1676261021931"} 2023-02-13 04:03:41,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=37 2023-02-13 04:03:41,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=37, state=SUCCESS; CloseRegionProcedure 4eb1de542dca16f0a37b4785daf70ae5, server=jenkins-hbase4.apache.org,35817,1676261010095 in 195 msec 2023-02-13 04:03:41,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4eb1de542dca16f0a37b4785daf70ae5, UNASSIGN in 209 msec 2023-02-13 04:03:41,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=38 2023-02-13 04:03:41,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=38, state=SUCCESS; CloseRegionProcedure cb9464752b5ad5b19e32ab69fb72a292, server=jenkins-hbase4.apache.org,41187,1676261010144 in 197 msec 2023-02-13 04:03:41,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cb9464752b5ad5b19e32ab69fb72a292, UNASSIGN in 211 msec 2023-02-13 04:03:41,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 04:03:41,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e. 2023-02-13 04:03:41,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e5a407ccfe975eabb2dfab30fc24310e: Waiting for close lock at 1676261021931Running coprocessor pre-close hooks at 1676261021931Disabling compacts and flushes for region at 1676261021931Disabling writes for close at 1676261021931Writing region close event to WAL at 1676261021931Running coprocessor post-close hooks at 1676261021951 (+20 ms)Closed at 1676261021951 2023-02-13 04:03:41,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:41,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4. 2023-02-13 04:03:41,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e6ef3bb677a3d00689bba717531bd7f4: Waiting for close lock at 1676261021927Running coprocessor pre-close hooks at 1676261021927Disabling compacts and flushes for region at 1676261021927Disabling writes for close at 1676261021927Writing region close event to WAL at 1676261021947 (+20 ms)Running coprocessor post-close hooks at 1676261021953 (+6 ms)Closed at 1676261021953 2023-02-13 04:03:41,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:41,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:41,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dc6b2d2002459ad34b0efeeb03100144, disabling compactions & flushes 2023-02-13 04:03:41,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:41,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:41,955 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e5a407ccfe975eabb2dfab30fc24310e, regionState=CLOSED 2023-02-13 04:03:41,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. after waiting 0 ms 2023-02-13 04:03:41,955 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261021955"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261021955"}]},"ts":"1676261021955"} 2023-02-13 04:03:41,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:41,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:41,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:41,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cd276396ab5ce2b0b9332f4d4be9f49f, disabling compactions & flushes 2023-02-13 04:03:41,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:41,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:41,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. after waiting 0 ms 2023-02-13 04:03:41,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:41,957 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=e6ef3bb677a3d00689bba717531bd7f4, regionState=CLOSED 2023-02-13 04:03:41,957 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021957"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261021957"}]},"ts":"1676261021957"} 2023-02-13 04:03:41,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-13 04:03:41,964 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure e5a407ccfe975eabb2dfab30fc24310e, server=jenkins-hbase4.apache.org,41187,1676261010144 in 219 msec 2023-02-13 04:03:41,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-13 04:03:41,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e5a407ccfe975eabb2dfab30fc24310e, UNASSIGN in 236 msec 2023-02-13 04:03:41,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure e6ef3bb677a3d00689bba717531bd7f4, server=jenkins-hbase4.apache.org,35817,1676261010095 in 227 msec 2023-02-13 04:03:41,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e6ef3bb677a3d00689bba717531bd7f4, UNASSIGN in 240 msec 2023-02-13 04:03:41,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:41,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144. 2023-02-13 04:03:41,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dc6b2d2002459ad34b0efeeb03100144: Waiting for close lock at 1676261021954Running coprocessor pre-close hooks at 1676261021954Disabling compacts and flushes for region at 1676261021954Disabling writes for close at 1676261021955 (+1 ms)Writing region close event to WAL at 1676261021963 (+8 ms)Running coprocessor post-close hooks at 1676261021980 (+17 ms)Closed at 1676261021981 (+1 ms) 2023-02-13 04:03:41,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:41,983 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=dc6b2d2002459ad34b0efeeb03100144, regionState=CLOSED 2023-02-13 04:03:41,983 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261021983"}]},"ts":"1676261021983"} 2023-02-13 04:03:41,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f. 2023-02-13 04:03:41,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cd276396ab5ce2b0b9332f4d4be9f49f: Waiting for close lock at 1676261021956Running coprocessor pre-close hooks at 1676261021956Disabling compacts and flushes for region at 1676261021956Disabling writes for close at 1676261021957 (+1 ms)Writing region close event to WAL at 1676261021979 (+22 ms)Running coprocessor post-close hooks at 1676261021984 (+5 ms)Closed at 1676261021984 2023-02-13 04:03:41,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:41,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:41,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e908bf8c87ab34e33cb35ccd524fbb61, disabling compactions & flushes 2023-02-13 04:03:41,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:41,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:41,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. after waiting 0 ms 2023-02-13 04:03:41,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:41,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:41,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:41,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3c481a2d44e2a4fd155314a0041701f4, disabling compactions & flushes 2023-02-13 04:03:41,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:41,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:41,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. after waiting 0 ms 2023-02-13 04:03:41,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:41,987 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=cd276396ab5ce2b0b9332f4d4be9f49f, regionState=CLOSED 2023-02-13 04:03:41,988 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261021987"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261021987"}]},"ts":"1676261021987"} 2023-02-13 04:03:41,994 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=42 2023-02-13 04:03:41,994 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=42, state=SUCCESS; CloseRegionProcedure dc6b2d2002459ad34b0efeeb03100144, server=jenkins-hbase4.apache.org,41187,1676261010144 in 233 msec 2023-02-13 04:03:41,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-13 04:03:41,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure cd276396ab5ce2b0b9332f4d4be9f49f, server=jenkins-hbase4.apache.org,35817,1676261010095 in 235 msec 2023-02-13 04:03:41,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dc6b2d2002459ad34b0efeeb03100144, UNASSIGN in 266 msec 2023-02-13 04:03:41,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 04:03:41,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:41,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cd276396ab5ce2b0b9332f4d4be9f49f, UNASSIGN in 269 msec 2023-02-13 04:03:41,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61. 2023-02-13 04:03:41,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e908bf8c87ab34e33cb35ccd524fbb61: Waiting for close lock at 1676261021985Running coprocessor pre-close hooks at 1676261021985Disabling compacts and flushes for region at 1676261021985Disabling writes for close at 1676261021985Writing region close event to WAL at 1676261021985Running coprocessor post-close hooks at 1676261021997 (+12 ms)Closed at 1676261021997 2023-02-13 04:03:41,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4. 2023-02-13 04:03:41,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3c481a2d44e2a4fd155314a0041701f4: Waiting for close lock at 1676261021987Running coprocessor pre-close hooks at 1676261021987Disabling compacts and flushes for region at 1676261021987Disabling writes for close at 1676261021987Writing region close event to WAL at 1676261021990 (+3 ms)Running coprocessor post-close hooks at 1676261021998 (+8 ms)Closed at 1676261021998 2023-02-13 04:03:42,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:42,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:42,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5015f186b2add7597cdf44bd360bc815, disabling compactions & flushes 2023-02-13 04:03:42,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:42,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:42,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. after waiting 0 ms 2023-02-13 04:03:42,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:42,001 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=e908bf8c87ab34e33cb35ccd524fbb61, regionState=CLOSED 2023-02-13 04:03:42,001 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261022001"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261022001"}]},"ts":"1676261022001"} 2023-02-13 04:03:42,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:42,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:42,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ef40a30f4f57b6d0b3597de97041a459, disabling compactions & flushes 2023-02-13 04:03:42,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:42,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:42,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. after waiting 0 ms 2023-02-13 04:03:42,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:42,002 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3c481a2d44e2a4fd155314a0041701f4, regionState=CLOSED 2023-02-13 04:03:42,002 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261022002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261022002"}]},"ts":"1676261022002"} 2023-02-13 04:03:42,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=34 2023-02-13 04:03:42,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=34, state=SUCCESS; CloseRegionProcedure e908bf8c87ab34e33cb35ccd524fbb61, server=jenkins-hbase4.apache.org,41187,1676261010144 in 245 msec 2023-02-13 04:03:42,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=41 2023-02-13 04:03:42,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=41, state=SUCCESS; CloseRegionProcedure 3c481a2d44e2a4fd155314a0041701f4, server=jenkins-hbase4.apache.org,35817,1676261010095 in 254 msec 2023-02-13 04:03:42,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e908bf8c87ab34e33cb35ccd524fbb61, UNASSIGN in 280 msec 2023-02-13 04:03:42,008 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3c481a2d44e2a4fd155314a0041701f4, UNASSIGN in 280 msec 2023-02-13 04:03:42,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:42,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:42,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 04:03:42,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815. 2023-02-13 04:03:42,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5015f186b2add7597cdf44bd360bc815: Waiting for close lock at 1676261022000Running coprocessor pre-close hooks at 1676261022000Disabling compacts and flushes for region at 1676261022000Disabling writes for close at 1676261022000Writing region close event to WAL at 1676261022021 (+21 ms)Running coprocessor post-close hooks at 1676261022026 (+5 ms)Closed at 1676261022027 (+1 ms) 2023-02-13 04:03:42,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459. 2023-02-13 04:03:42,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ef40a30f4f57b6d0b3597de97041a459: Waiting for close lock at 1676261022001Running coprocessor pre-close hooks at 1676261022001Disabling compacts and flushes for region at 1676261022001Disabling writes for close at 1676261022001Writing region close event to WAL at 1676261022020 (+19 ms)Running coprocessor post-close hooks at 1676261022028 (+8 ms)Closed at 1676261022028 2023-02-13 04:03:42,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:42,031 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=5015f186b2add7597cdf44bd360bc815, regionState=CLOSED 2023-02-13 04:03:42,031 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261022031"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261022031"}]},"ts":"1676261022031"} 2023-02-13 04:03:42,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:42,033 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=ef40a30f4f57b6d0b3597de97041a459, regionState=CLOSED 2023-02-13 04:03:42,034 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261022033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261022033"}]},"ts":"1676261022033"} 2023-02-13 04:03:42,044 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=39 2023-02-13 04:03:42,044 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=39, state=SUCCESS; CloseRegionProcedure ef40a30f4f57b6d0b3597de97041a459, server=jenkins-hbase4.apache.org,35817,1676261010095 in 296 msec 2023-02-13 04:03:42,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=35 2023-02-13 04:03:42,045 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=35, state=SUCCESS; CloseRegionProcedure 5015f186b2add7597cdf44bd360bc815, server=jenkins-hbase4.apache.org,41187,1676261010144 in 278 msec 2023-02-13 04:03:42,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ef40a30f4f57b6d0b3597de97041a459, UNASSIGN in 318 msec 2023-02-13 04:03:42,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=35, resume processing ppid=33 2023-02-13 04:03:42,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5015f186b2add7597cdf44bd360bc815, UNASSIGN in 320 msec 2023-02-13 04:03:42,049 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261022049"}]},"ts":"1676261022049"} 2023-02-13 04:03:42,051 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-13 04:03:42,053 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-13 04:03:42,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 343 msec 2023-02-13 04:03:42,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 04:03:42,330 INFO [Listener at localhost/42775] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-13 04:03:42,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-13 04:03:42,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:03:42,345 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:03:42,347 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:03:42,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 04:03:42,363 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:42,363 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:42,363 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:42,363 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:42,363 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:42,363 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:42,363 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:42,363 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:42,369 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/f1, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/f2, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/recovered.edits] 2023-02-13 04:03:42,369 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/recovered.edits] 2023-02-13 04:03:42,369 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/recovered.edits] 2023-02-13 04:03:42,369 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/recovered.edits] 2023-02-13 04:03:42,369 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/recovered.edits] 2023-02-13 04:03:42,369 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/recovered.edits] 2023-02-13 04:03:42,370 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/recovered.edits] 2023-02-13 04:03:42,372 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/recovered.edits] 2023-02-13 04:03:42,382 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/16043ca7727647ddb7a25cf702ef8062 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/16043ca7727647ddb7a25cf702ef8062 2023-02-13 04:03:42,382 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/8241427640f443f9a927736e7b39ff50 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/8241427640f443f9a927736e7b39ff50 2023-02-13 04:03:42,382 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/46ea15019f5a49d2bd557d03933bfdc6 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/46ea15019f5a49d2bd557d03933bfdc6 2023-02-13 04:03:42,383 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/2074a337e6cd43079feab7be5d5f56d5 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/2074a337e6cd43079feab7be5d5f56d5 2023-02-13 04:03:42,383 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/a0a9b8bc0f304826ba9c55931dd5c96a to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/a0a9b8bc0f304826ba9c55931dd5c96a 2023-02-13 04:03:42,383 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/c34cda284d964f43ad73e5a3f0644913 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/c34cda284d964f43ad73e5a3f0644913 2023-02-13 04:03:42,384 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/70a31ab1db824310b84bbaa3be41788a to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/70a31ab1db824310b84bbaa3be41788a 2023-02-13 04:03:42,390 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/93fccdfb380d4b7cbabd416a61739a4f to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f1/93fccdfb380d4b7cbabd416a61739a4f 2023-02-13 04:03:42,390 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/5cadfc43b5ac4a30b2714b029fa0a82d to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f1/5cadfc43b5ac4a30b2714b029fa0a82d 2023-02-13 04:03:42,391 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/b669d82f8af541d48f0d9d294ced0755 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f1/b669d82f8af541d48f0d9d294ced0755 2023-02-13 04:03:42,391 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/237d0c3ac7024b029aecf4b3ae401eab to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f1/237d0c3ac7024b029aecf4b3ae401eab 2023-02-13 04:03:42,391 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/c79a26db14094bd2b244ef2d17233fd6 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f1/c79a26db14094bd2b244ef2d17233fd6 2023-02-13 04:03:42,391 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/a584a49b66c043f6975255fc463f5558 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f1/a584a49b66c043f6975255fc463f5558 2023-02-13 04:03:42,392 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/e4e35becff5544529c8a6d8fe39d8e6d to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f1/e4e35becff5544529c8a6d8fe39d8e6d 2023-02-13 04:03:42,393 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/recovered.edits/6.seqid to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61/recovered.edits/6.seqid 2023-02-13 04:03:42,394 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e908bf8c87ab34e33cb35ccd524fbb61 2023-02-13 04:03:42,395 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:42,399 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/852a27b6b2cf40cc98ac1d146b896045 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/852a27b6b2cf40cc98ac1d146b896045 2023-02-13 04:03:42,399 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/2d731bb3e7364830855b671749ac18c4 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/2d731bb3e7364830855b671749ac18c4 2023-02-13 04:03:42,400 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/6942910b91674c46a48b27d68000e14c to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/6942910b91674c46a48b27d68000e14c 2023-02-13 04:03:42,400 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/9990c155b27248a198c744d84ca52a5a to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/9990c155b27248a198c744d84ca52a5a 2023-02-13 04:03:42,401 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/recovered.edits] 2023-02-13 04:03:42,401 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/3193d93a41fd42aa93da8530b6e07ef0 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/3193d93a41fd42aa93da8530b6e07ef0 2023-02-13 04:03:42,401 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/47b89da6c4ce41328cf2e896c3a40cc5 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/47b89da6c4ce41328cf2e896c3a40cc5 2023-02-13 04:03:42,402 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/1f9f0c956b1a444eb93b15bb36d7a774 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/1f9f0c956b1a444eb93b15bb36d7a774 2023-02-13 04:03:42,404 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/d82f18d0d0ac48ccbaece3b4e89a02a6 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/f2/d82f18d0d0ac48ccbaece3b4e89a02a6 2023-02-13 04:03:42,404 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/a911c1bd23b44b98b5ce87b1fa6d5f42 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/f2/a911c1bd23b44b98b5ce87b1fa6d5f42 2023-02-13 04:03:42,404 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/8dab7ad3b509427fabb2ec6cf70ce274 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/f2/8dab7ad3b509427fabb2ec6cf70ce274 2023-02-13 04:03:42,406 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/e8f6d199f0bc4a6ab8d6c973a71e5ec0 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/f2/e8f6d199f0bc4a6ab8d6c973a71e5ec0 2023-02-13 04:03:42,409 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/692ed1c7266f4f919a8d6b4a86debe69 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/f2/692ed1c7266f4f919a8d6b4a86debe69 2023-02-13 04:03:42,409 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/6424daf9706a4f3d8cdb393f0f49f2e9 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/f2/6424daf9706a4f3d8cdb393f0f49f2e9 2023-02-13 04:03:42,409 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/aa66fc0949fe49d3944ff96ab1bb4594 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/f2/aa66fc0949fe49d3944ff96ab1bb4594 2023-02-13 04:03:42,412 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/0b8d656a03604c5d8e8e2b3e85831375 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/0b8d656a03604c5d8e8e2b3e85831375 2023-02-13 04:03:42,413 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/recovered.edits/12.seqid to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f/recovered.edits/12.seqid 2023-02-13 04:03:42,414 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/recovered.edits/12.seqid to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459/recovered.edits/12.seqid 2023-02-13 04:03:42,414 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/recovered.edits/12.seqid to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292/recovered.edits/12.seqid 2023-02-13 04:03:42,415 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cd276396ab5ce2b0b9332f4d4be9f49f 2023-02-13 04:03:42,415 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:42,415 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/5f7d41e4f42d4db58232b1f35f625f24 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f1/5f7d41e4f42d4db58232b1f35f625f24 2023-02-13 04:03:42,416 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/ef40a30f4f57b6d0b3597de97041a459 2023-02-13 04:03:42,416 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/cb9464752b5ad5b19e32ab69fb72a292 2023-02-13 04:03:42,418 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/recovered.edits/12.seqid to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815/recovered.edits/12.seqid 2023-02-13 04:03:42,418 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/recovered.edits/12.seqid to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4/recovered.edits/12.seqid 2023-02-13 04:03:42,419 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/5015f186b2add7597cdf44bd360bc815 2023-02-13 04:03:42,420 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/recovered.edits/12.seqid to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5/recovered.edits/12.seqid 2023-02-13 04:03:42,420 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/recovered.edits/12.seqid to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4/recovered.edits/12.seqid 2023-02-13 04:03:42,420 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e6ef3bb677a3d00689bba717531bd7f4 2023-02-13 04:03:42,420 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/f1, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/f2, FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/recovered.edits] 2023-02-13 04:03:42,421 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/3c481a2d44e2a4fd155314a0041701f4 2023-02-13 04:03:42,421 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/4eb1de542dca16f0a37b4785daf70ae5 2023-02-13 04:03:42,423 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/8002dc76e27845a198093849bb0b2572 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/8002dc76e27845a198093849bb0b2572 2023-02-13 04:03:42,424 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/e7efde55a2b94a31bdb8cdb73fc89f59 to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/f2/e7efde55a2b94a31bdb8cdb73fc89f59 2023-02-13 04:03:42,427 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/recovered.edits/6.seqid to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e/recovered.edits/6.seqid 2023-02-13 04:03:42,428 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/recovered.edits/12.seqid to hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/archive/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144/recovered.edits/12.seqid 2023-02-13 04:03:42,428 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/e5a407ccfe975eabb2dfab30fc24310e 2023-02-13 04:03:42,429 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/.tmp/data/default/testWithMapReduce/dc6b2d2002459ad34b0efeeb03100144 2023-02-13 04:03:42,429 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 04:03:42,437 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:03:42,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 04:03:42,460 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-13 04:03:42,464 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261022466"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261022466"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261022466"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261022466"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261022466"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261022466"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261022466"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261022466"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261022466"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,466 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261022466"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,469 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-13 04:03:42,469 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e908bf8c87ab34e33cb35ccd524fbb61, NAME => 'testWithMapReduce,,1676261013019.e908bf8c87ab34e33cb35ccd524fbb61.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 5015f186b2add7597cdf44bd360bc815, NAME => 'testWithMapReduce,aaa,1676261013019.5015f186b2add7597cdf44bd360bc815.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => e6ef3bb677a3d00689bba717531bd7f4, NAME => 'testWithMapReduce,d\x84\x84,1676261013019.e6ef3bb677a3d00689bba717531bd7f4.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 4eb1de542dca16f0a37b4785daf70ae5, NAME => 'testWithMapReduce,g\xA7\xA7,1676261013019.4eb1de542dca16f0a37b4785daf70ae5.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => cb9464752b5ad5b19e32ab69fb72a292, NAME => 'testWithMapReduce,j\xCA\xCA,1676261013019.cb9464752b5ad5b19e32ab69fb72a292.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => ef40a30f4f57b6d0b3597de97041a459, NAME => 'testWithMapReduce,m\xED\xED,1676261013019.ef40a30f4f57b6d0b3597de97041a459.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => cd276396ab5ce2b0b9332f4d4be9f49f, NAME => 'testWithMapReduce,q\x11\x10,1676261013019.cd276396ab5ce2b0b9332f4d4be9f49f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 3c481a2d44e2a4fd155314a0041701f4, NAME => 'testWithMapReduce,t43,1676261013019.3c481a2d44e2a4fd155314a0041701f4.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => dc6b2d2002459ad34b0efeeb03100144, NAME => 'testWithMapReduce,wWV,1676261013019.dc6b2d2002459ad34b0efeeb03100144.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => e5a407ccfe975eabb2dfab30fc24310e, NAME => 'testWithMapReduce,zz{,1676261013019.e5a407ccfe975eabb2dfab30fc24310e.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-13 04:03:42,469 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-13 04:03:42,469 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676261022469"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:42,471 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-13 04:03:42,473 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:03:42,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 137 msec 2023-02-13 04:03:42,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40081] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 04:03:42,653 INFO [Listener at localhost/42775] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-13 04:03:42,653 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 04:03:42,653 INFO [Listener at localhost/42775] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:03:42,653 DEBUG [Listener at localhost/42775] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b8795d6 to 127.0.0.1:60256 2023-02-13 04:03:42,653 DEBUG [Listener at localhost/42775] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:42,653 DEBUG [Listener at localhost/42775] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 04:03:42,653 DEBUG [Listener at localhost/42775] util.JVMClusterUtil(257): Found active master hash=307809516, stopped=false 2023-02-13 04:03:42,653 INFO [Listener at localhost/42775] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40081,1676261008871 2023-02-13 04:03:42,656 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:42,656 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:42,656 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:42,656 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:42,656 INFO [Listener at localhost/42775] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 04:03:42,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:42,657 DEBUG [Listener at localhost/42775] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30fa0357 to 127.0.0.1:60256 2023-02-13 04:03:42,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:42,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:42,658 DEBUG [Listener at localhost/42775] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:42,658 INFO [Listener at localhost/42775] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35817,1676261010095' ***** 2023-02-13 04:03:42,658 INFO [Listener at localhost/42775] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:03:42,658 INFO [Listener at localhost/42775] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41187,1676261010144' ***** 2023-02-13 04:03:42,658 INFO [Listener at localhost/42775] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:03:42,658 INFO [RS:0;jenkins-hbase4:35817] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:03:42,659 INFO [RS:1;jenkins-hbase4:41187] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:03:42,659 INFO [RS:1;jenkins-hbase4:41187] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:03:42,659 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:03:42,659 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:03:42,659 INFO [RS:0;jenkins-hbase4:35817] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:03:42,659 INFO [RS:1;jenkins-hbase4:41187] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:03:42,660 INFO [RS:0;jenkins-hbase4:35817] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:03:42,660 INFO [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:42,660 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(3304): Received CLOSE for 46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:42,660 DEBUG [RS:1;jenkins-hbase4:41187] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c8ef22b to 127.0.0.1:60256 2023-02-13 04:03:42,660 DEBUG [RS:1;jenkins-hbase4:41187] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:42,660 INFO [RS:1;jenkins-hbase4:41187] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:03:42,660 INFO [RS:1;jenkins-hbase4:41187] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:03:42,660 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:42,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 46bf8d61def62d889aa08263fb36be6a, disabling compactions & flushes 2023-02-13 04:03:42,661 DEBUG [RS:0;jenkins-hbase4:35817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e5751fe to 127.0.0.1:60256 2023-02-13 04:03:42,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:42,661 DEBUG [RS:0;jenkins-hbase4:35817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:42,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:42,661 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 04:03:42,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. after waiting 0 ms 2023-02-13 04:03:42,660 INFO [RS:1;jenkins-hbase4:41187] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:03:42,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:42,661 INFO [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 04:03:42,661 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1479): Online Regions={46bf8d61def62d889aa08263fb36be6a=hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a.} 2023-02-13 04:03:42,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 46bf8d61def62d889aa08263fb36be6a 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 04:03:42,661 INFO [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 04:03:42,661 DEBUG [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 04:03:42,662 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:03:42,662 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:03:42,662 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:03:42,662 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:03:42,662 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:03:42,662 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-13 04:03:42,663 DEBUG [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 04:03:42,663 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1505): Waiting on 46bf8d61def62d889aa08263fb36be6a 2023-02-13 04:03:42,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a/.tmp/info/173aaab3b084458383420659299c9d8c 2023-02-13 04:03:42,686 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/.tmp/info/2f31b301284d41869565220dc9fe0a69 2023-02-13 04:03:42,693 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:42,694 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:42,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a/.tmp/info/173aaab3b084458383420659299c9d8c as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a/info/173aaab3b084458383420659299c9d8c 2023-02-13 04:03:42,695 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f31b301284d41869565220dc9fe0a69 2023-02-13 04:03:42,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a/info/173aaab3b084458383420659299c9d8c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 04:03:42,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 46bf8d61def62d889aa08263fb36be6a in 45ms, sequenceid=6, compaction requested=false 2023-02-13 04:03:42,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/.tmp/rep_barrier/13a1dd28fb664d808b61fa5b154bec8f 2023-02-13 04:03:42,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/namespace/46bf8d61def62d889aa08263fb36be6a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 04:03:42,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:42,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 46bf8d61def62d889aa08263fb36be6a: Waiting for close lock at 1676261022660Running coprocessor pre-close hooks at 1676261022660Disabling compacts and flushes for region at 1676261022660Disabling writes for close at 1676261022661 (+1 ms)Obtaining lock to block concurrent updates at 1676261022661Preparing flush snapshotting stores in 46bf8d61def62d889aa08263fb36be6a at 1676261022661Finished memstore snapshotting hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676261022661Flushing stores of hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. at 1676261022663 (+2 ms)Flushing 46bf8d61def62d889aa08263fb36be6a/info: creating writer at 1676261022663Flushing 46bf8d61def62d889aa08263fb36be6a/info: appending metadata at 1676261022666 (+3 ms)Flushing 46bf8d61def62d889aa08263fb36be6a/info: closing flushed file at 1676261022666Flushing 46bf8d61def62d889aa08263fb36be6a/info: reopening flushed file at 1676261022695 (+29 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 46bf8d61def62d889aa08263fb36be6a in 45ms, sequenceid=6, compaction requested=false at 1676261022706 (+11 ms)Writing region close event to WAL at 1676261022713 (+7 ms)Running coprocessor post-close hooks at 1676261022718 (+5 ms)Closed at 1676261022718 2023-02-13 04:03:42,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676261012107.46bf8d61def62d889aa08263fb36be6a. 2023-02-13 04:03:42,723 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13a1dd28fb664d808b61fa5b154bec8f 2023-02-13 04:03:42,741 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/.tmp/table/d5590dd961be47aa917568b949c4c7ee 2023-02-13 04:03:42,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5590dd961be47aa917568b949c4c7ee 2023-02-13 04:03:42,751 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/.tmp/info/2f31b301284d41869565220dc9fe0a69 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/info/2f31b301284d41869565220dc9fe0a69 2023-02-13 04:03:42,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f31b301284d41869565220dc9fe0a69 2023-02-13 04:03:42,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/info/2f31b301284d41869565220dc9fe0a69, entries=30, sequenceid=57, filesize=7.9 K 2023-02-13 04:03:42,760 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/.tmp/rep_barrier/13a1dd28fb664d808b61fa5b154bec8f as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/rep_barrier/13a1dd28fb664d808b61fa5b154bec8f 2023-02-13 04:03:42,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13a1dd28fb664d808b61fa5b154bec8f 2023-02-13 04:03:42,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/rep_barrier/13a1dd28fb664d808b61fa5b154bec8f, entries=10, sequenceid=57, filesize=5.9 K 2023-02-13 04:03:42,767 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/.tmp/table/d5590dd961be47aa917568b949c4c7ee as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/table/d5590dd961be47aa917568b949c4c7ee 2023-02-13 04:03:42,773 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5590dd961be47aa917568b949c4c7ee 2023-02-13 04:03:42,773 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/table/d5590dd961be47aa917568b949c4c7ee, entries=13, sequenceid=57, filesize=5.9 K 2023-02-13 04:03:42,774 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 112ms, sequenceid=57, compaction requested=false 2023-02-13 04:03:42,785 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-13 04:03:42,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 04:03:42,787 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:03:42,787 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261022661Running coprocessor pre-close hooks at 1676261022661Disabling compacts and flushes for region at 1676261022662 (+1 ms)Disabling writes for close at 1676261022662Obtaining lock to block concurrent updates at 1676261022662Preparing flush snapshotting stores in 1588230740 at 1676261022662Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676261022663 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676261022663Flushing 1588230740/info: creating writer at 1676261022664 (+1 ms)Flushing 1588230740/info: appending metadata at 1676261022669 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676261022669Flushing 1588230740/rep_barrier: creating writer at 1676261022695 (+26 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676261022698 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676261022698Flushing 1588230740/table: creating writer at 1676261022723 (+25 ms)Flushing 1588230740/table: appending metadata at 1676261022728 (+5 ms)Flushing 1588230740/table: closing flushed file at 1676261022728Flushing 1588230740/info: reopening flushed file at 1676261022752 (+24 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676261022761 (+9 ms)Flushing 1588230740/table: reopening flushed file at 1676261022768 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 112ms, sequenceid=57, compaction requested=false at 1676261022774 (+6 ms)Writing region close event to WAL at 1676261022782 (+8 ms)Running coprocessor post-close hooks at 1676261022786 (+4 ms)Closed at 1676261022787 (+1 ms) 2023-02-13 04:03:42,788 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 04:03:42,864 INFO [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41187,1676261010144; all regions closed. 2023-02-13 04:03:42,864 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35817,1676261010095; all regions closed. 2023-02-13 04:03:42,874 DEBUG [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/oldWALs 2023-02-13 04:03:42,874 INFO [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35817%2C1676261010095:(num 1676261012545) 2023-02-13 04:03:42,874 DEBUG [RS:0;jenkins-hbase4:35817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:42,875 DEBUG [RS:1;jenkins-hbase4:41187] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/oldWALs 2023-02-13 04:03:42,875 INFO [RS:0;jenkins-hbase4:35817] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:42,875 INFO [RS:1;jenkins-hbase4:41187] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41187%2C1676261010144.meta:.meta(num 1676261011835) 2023-02-13 04:03:42,875 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 04:03:42,875 INFO [RS:0;jenkins-hbase4:35817] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:03:42,875 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:03:42,875 INFO [RS:0;jenkins-hbase4:35817] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:03:42,875 INFO [RS:0;jenkins-hbase4:35817] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:03:42,877 INFO [RS:0;jenkins-hbase4:35817] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35817 2023-02-13 04:03:42,884 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:42,885 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:42,885 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:42,884 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35817,1676261010095 2023-02-13 04:03:42,885 ERROR [Listener at localhost/42775-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f92bbc1 rejected from java.util.concurrent.ThreadPoolExecutor@4bad26eb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:42,885 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:42,885 ERROR [Listener at localhost/42775-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@657d0c21 rejected from java.util.concurrent.ThreadPoolExecutor@4bad26eb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:42,886 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35817,1676261010095] 2023-02-13 04:03:42,886 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35817,1676261010095; numProcessing=1 2023-02-13 04:03:42,887 DEBUG [RS:1;jenkins-hbase4:41187] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/oldWALs 2023-02-13 04:03:42,887 INFO [RS:1;jenkins-hbase4:41187] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41187%2C1676261010144:(num 1676261012546) 2023-02-13 04:03:42,887 DEBUG [RS:1;jenkins-hbase4:41187] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:42,887 INFO [RS:1;jenkins-hbase4:41187] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:42,887 INFO [RS:1;jenkins-hbase4:41187] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 04:03:42,888 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:03:42,888 INFO [RS:1;jenkins-hbase4:41187] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41187 2023-02-13 04:03:42,889 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35817,1676261010095 already deleted, retry=false 2023-02-13 04:03:42,890 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35817,1676261010095 expired; onlineServers=1 2023-02-13 04:03:42,891 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41187,1676261010144 2023-02-13 04:03:42,891 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:42,891 ERROR [Listener at localhost/42775-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@590711ab rejected from java.util.concurrent.ThreadPoolExecutor@5d389e53[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:42,892 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41187,1676261010144] 2023-02-13 04:03:42,892 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41187,1676261010144; numProcessing=2 2023-02-13 04:03:42,895 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41187,1676261010144 already deleted, retry=false 2023-02-13 04:03:42,895 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41187,1676261010144 expired; onlineServers=0 2023-02-13 04:03:42,895 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40081,1676261008871' ***** 2023-02-13 04:03:42,895 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 04:03:42,895 DEBUG [M:0;jenkins-hbase4:40081] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5365c6d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:42,896 INFO [M:0;jenkins-hbase4:40081] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40081,1676261008871 2023-02-13 04:03:42,896 INFO [M:0;jenkins-hbase4:40081] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40081,1676261008871; all regions closed. 2023-02-13 04:03:42,896 DEBUG [M:0;jenkins-hbase4:40081] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:42,896 DEBUG [M:0;jenkins-hbase4:40081] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 04:03:42,896 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 04:03:42,896 DEBUG [M:0;jenkins-hbase4:40081] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 04:03:42,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261011307] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261011307,5,FailOnTimeoutGroup] 2023-02-13 04:03:42,898 INFO [M:0;jenkins-hbase4:40081] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 04:03:42,898 INFO [M:0;jenkins-hbase4:40081] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 04:03:42,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261011307] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261011307,5,FailOnTimeoutGroup] 2023-02-13 04:03:42,898 INFO [M:0;jenkins-hbase4:40081] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 04:03:42,898 DEBUG [M:0;jenkins-hbase4:40081] master.HMaster(1502): Stopping service threads 2023-02-13 04:03:42,899 INFO [M:0;jenkins-hbase4:40081] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 04:03:42,899 ERROR [M:0;jenkins-hbase4:40081] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] 2023-02-13 04:03:42,899 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-13 04:03:42,899 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:42,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:42,900 INFO [M:0;jenkins-hbase4:40081] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 04:03:42,900 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 04:03:42,901 DEBUG [M:0;jenkins-hbase4:40081] zookeeper.ZKUtil(398): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 04:03:42,901 WARN [M:0;jenkins-hbase4:40081] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 04:03:42,901 INFO [M:0;jenkins-hbase4:40081] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 04:03:42,901 INFO [M:0;jenkins-hbase4:40081] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 04:03:42,902 DEBUG [M:0;jenkins-hbase4:40081] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:03:42,902 INFO [M:0;jenkins-hbase4:40081] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:42,902 DEBUG [M:0;jenkins-hbase4:40081] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:42,902 DEBUG [M:0;jenkins-hbase4:40081] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:03:42,902 DEBUG [M:0;jenkins-hbase4:40081] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:42,902 INFO [M:0;jenkins-hbase4:40081] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.25 KB heapSize=192.17 KB 2023-02-13 04:03:42,919 INFO [M:0;jenkins-hbase4:40081] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.25 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/47a30386dfbc4e2da59317fa1b94d9d4 2023-02-13 04:03:42,925 DEBUG [M:0;jenkins-hbase4:40081] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/47a30386dfbc4e2da59317fa1b94d9d4 as hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/47a30386dfbc4e2da59317fa1b94d9d4 2023-02-13 04:03:42,931 INFO [M:0;jenkins-hbase4:40081] regionserver.HStore(1080): Added hdfs://localhost:33353/user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/47a30386dfbc4e2da59317fa1b94d9d4, entries=53, sequenceid=357, filesize=10.4 K 2023-02-13 04:03:42,932 INFO [M:0;jenkins-hbase4:40081] regionserver.HRegion(2947): Finished flush of dataSize ~159.25 KB/163067, heapSize ~192.16 KB/196768, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=357, compaction requested=false 2023-02-13 04:03:42,934 INFO [M:0;jenkins-hbase4:40081] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:42,934 DEBUG [M:0;jenkins-hbase4:40081] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261022901Disabling compacts and flushes for region at 1676261022901Disabling writes for close at 1676261022902 (+1 ms)Obtaining lock to block concurrent updates at 1676261022902Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676261022902Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163067, getHeapSize=196768, getOffHeapSize=0, getCellsCount=442 at 1676261022902Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676261022903 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676261022904 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676261022908 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676261022908Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676261022926 (+18 ms)Finished flush of dataSize ~159.25 KB/163067, heapSize ~192.16 KB/196768, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=357, compaction requested=false at 1676261022932 (+6 ms)Writing region close event to WAL at 1676261022934 (+2 ms)Closed at 1676261022934 2023-02-13 04:03:42,963 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/1b7d4030-ce7b-a958-9e40-8b468bb2f756/MasterData/WALs/jenkins-hbase4.apache.org,40081,1676261008871/jenkins-hbase4.apache.org%2C40081%2C1676261008871.1676261010605 not finished, retry = 0 2023-02-13 04:03:43,065 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:03:43,065 INFO [M:0;jenkins-hbase4:40081] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 04:03:43,065 INFO [M:0;jenkins-hbase4:40081] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40081 2023-02-13 04:03:43,068 DEBUG [M:0;jenkins-hbase4:40081] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40081,1676261008871 already deleted, retry=false 2023-02-13 04:03:43,162 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:43,162 INFO [RS:1;jenkins-hbase4:41187] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41187,1676261010144; zookeeper connection closed. 2023-02-13 04:03:43,162 ERROR [Listener at localhost/42775-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48839c59 rejected from java.util.concurrent.ThreadPoolExecutor@5d389e53[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:43,162 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@35d535ab] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@35d535ab 2023-02-13 04:03:43,162 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:41187-0x1004bd90c110002, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:43,163 ERROR [Listener at localhost/42775-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@303b9fd3 rejected from java.util.concurrent.ThreadPoolExecutor@5d389e53[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:43,262 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35817,1676261010095; zookeeper connection closed. 2023-02-13 04:03:43,262 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:43,263 ERROR [Listener at localhost/42775-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d531c84 rejected from java.util.concurrent.ThreadPoolExecutor@4bad26eb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:43,263 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@61ba04a1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@61ba04a1 2023-02-13 04:03:43,263 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1004bd90c110001, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:43,263 ERROR [Listener at localhost/42775-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@63115b40 rejected from java.util.concurrent.ThreadPoolExecutor@4bad26eb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:43,263 INFO [Listener at localhost/42775] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 04:03:43,362 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:43,362 INFO [M:0;jenkins-hbase4:40081] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40081,1676261008871; zookeeper connection closed. 2023-02-13 04:03:43,363 ERROR [Listener at localhost/42775-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f59c802 rejected from java.util.concurrent.ThreadPoolExecutor@d4cdbfa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:43,363 DEBUG [Listener at localhost/42775-EventThread] zookeeper.ZKWatcher(600): master:40081-0x1004bd90c110000, quorum=127.0.0.1:60256, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:43,363 ERROR [Listener at localhost/42775-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2c78f36b rejected from java.util.concurrent.ThreadPoolExecutor@d4cdbfa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:43,365 WARN [Listener at localhost/42775] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:03:43,369 INFO [Listener at localhost/42775] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:03:43,472 WARN [BP-135360065-172.31.14.131-1676261005440 heartbeating to localhost/127.0.0.1:33353] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:03:43,472 WARN [BP-135360065-172.31.14.131-1676261005440 heartbeating to localhost/127.0.0.1:33353] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-135360065-172.31.14.131-1676261005440 (Datanode Uuid 72da109b-e06c-4ed5-a7dd-c4cb158b7b55) service to localhost/127.0.0.1:33353 2023-02-13 04:03:43,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/cluster_b88392a4-5917-dc8f-1e5a-bee1a286891a/dfs/data/data3/current/BP-135360065-172.31.14.131-1676261005440] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:43,474 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/cluster_b88392a4-5917-dc8f-1e5a-bee1a286891a/dfs/data/data4/current/BP-135360065-172.31.14.131-1676261005440] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:43,476 WARN [Listener at localhost/42775] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:03:43,481 INFO [Listener at localhost/42775] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:03:43,585 WARN [BP-135360065-172.31.14.131-1676261005440 heartbeating to localhost/127.0.0.1:33353] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:03:43,585 WARN [BP-135360065-172.31.14.131-1676261005440 heartbeating to localhost/127.0.0.1:33353] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-135360065-172.31.14.131-1676261005440 (Datanode Uuid 3ecdf8d0-8b01-4ce8-bed2-9e64874b5dfc) service to localhost/127.0.0.1:33353 2023-02-13 04:03:43,585 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/cluster_b88392a4-5917-dc8f-1e5a-bee1a286891a/dfs/data/data1/current/BP-135360065-172.31.14.131-1676261005440] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:43,586 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/cluster_b88392a4-5917-dc8f-1e5a-bee1a286891a/dfs/data/data2/current/BP-135360065-172.31.14.131-1676261005440] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:43,624 INFO [Listener at localhost/42775] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:03:43,745 INFO [Listener at localhost/42775] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 04:03:43,811 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 04:03:43,825 INFO [Listener at localhost/42775] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33353 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:33353 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33353 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,40081,1676261008871)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost/42775 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@f63b4e8 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:33353 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33353 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33353 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33353 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=547 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=238 (was 186) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4202 (was 5211) 2023-02-13 04:03:43,835 INFO [Listener at localhost/42775] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=547, MaxFileDescriptor=60000, SystemLoadAverage=238, ProcessCount=168, AvailableMemoryMB=4201 2023-02-13 04:03:43,846 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/hadoop.log.dir so I do NOT create it in target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162 2023-02-13 04:03:43,846 WARN [Listener at localhost/42775] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 04:03:43,846 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/hadoop.tmp.dir so I do NOT create it in target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162 2023-02-13 04:03:43,846 WARN [Listener at localhost/42775] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b04c58b5-001e-0909-9ac5-52246ce1d81a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 04:03:43,846 DEBUG [Listener at localhost/42775] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162 2023-02-13 04:03:43,846 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 04:03:43,846 INFO [Listener at localhost/42775] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/cluster_769789a9-472d-7750-b833-a89cbb41e651, deleteOnExit=true 2023-02-13 04:03:43,846 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 04:03:43,847 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/test.cache.data in system properties and HBase conf 2023-02-13 04:03:43,847 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 04:03:43,847 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/hadoop.log.dir in system properties and HBase conf 2023-02-13 04:03:43,847 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 04:03:43,847 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 04:03:43,847 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 04:03:43,847 DEBUG [Listener at localhost/42775] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 04:03:43,847 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:03:43,848 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:03:43,848 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 04:03:43,848 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:03:43,848 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 04:03:43,848 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 04:03:43,848 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:03:43,848 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:03:43,848 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 04:03:43,848 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/nfs.dump.dir in system properties and HBase conf 2023-02-13 04:03:43,849 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/java.io.tmpdir in system properties and HBase conf 2023-02-13 04:03:43,849 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:03:43,849 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 04:03:43,849 INFO [Listener at localhost/42775] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 04:03:43,854 WARN [Listener at localhost/42775] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:03:43,854 WARN [Listener at localhost/42775] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:03:43,902 WARN [Listener at localhost/42775] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:43,904 INFO [Listener at localhost/42775] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:43,908 INFO [Listener at localhost/42775] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/java.io.tmpdir/Jetty_localhost_43027_hdfs____.mq1gow/webapp 2023-02-13 04:03:44,001 INFO [Listener at localhost/42775] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43027 2023-02-13 04:03:44,044 WARN [Listener at localhost/42775] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:03:44,045 WARN [Listener at localhost/42775] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:03:44,100 WARN [Listener at localhost/33645] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:44,127 WARN [Listener at localhost/33645] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:03:44,129 WARN [Listener at localhost/33645] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:44,130 INFO [Listener at localhost/33645] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:44,136 INFO [Listener at localhost/33645] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/java.io.tmpdir/Jetty_localhost_36113_datanode____d56113/webapp 2023-02-13 04:03:44,239 INFO [Listener at localhost/33645] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36113 2023-02-13 04:03:44,248 WARN [Listener at localhost/41825] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:44,266 WARN [Listener at localhost/41825] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:03:44,269 WARN [Listener at localhost/41825] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:44,270 INFO [Listener at localhost/41825] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:44,274 INFO [Listener at localhost/41825] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/java.io.tmpdir/Jetty_localhost_39605_datanode____.uxips4/webapp 2023-02-13 04:03:44,368 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf4d324d1b3d6b627: Processing first storage report for DS-726db5bc-b2a3-4f50-8a88-bc6598b1fc8a from datanode 507f40ec-55cd-4775-9533-fffccbd2aa9a 2023-02-13 04:03:44,369 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf4d324d1b3d6b627: from storage DS-726db5bc-b2a3-4f50-8a88-bc6598b1fc8a node DatanodeRegistration(127.0.0.1:38871, datanodeUuid=507f40ec-55cd-4775-9533-fffccbd2aa9a, infoPort=38193, infoSecurePort=0, ipcPort=41825, storageInfo=lv=-57;cid=testClusterID;nsid=1165642678;c=1676261023856), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:44,369 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf4d324d1b3d6b627: Processing first storage report for DS-c850fe9d-bc6e-4a2b-8dcb-2213a5fe626c from datanode 507f40ec-55cd-4775-9533-fffccbd2aa9a 2023-02-13 04:03:44,369 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf4d324d1b3d6b627: from storage DS-c850fe9d-bc6e-4a2b-8dcb-2213a5fe626c node DatanodeRegistration(127.0.0.1:38871, datanodeUuid=507f40ec-55cd-4775-9533-fffccbd2aa9a, infoPort=38193, infoSecurePort=0, ipcPort=41825, storageInfo=lv=-57;cid=testClusterID;nsid=1165642678;c=1676261023856), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:44,388 INFO [Listener at localhost/41825] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39605 2023-02-13 04:03:44,400 WARN [Listener at localhost/36687] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:44,511 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa354030fb8dcdee8: Processing first storage report for DS-eca83f27-f6f5-43e0-8e25-f27ad6e108d4 from datanode a6411c56-34e1-44f3-a8a5-7593ae06f6ae 2023-02-13 04:03:44,511 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa354030fb8dcdee8: from storage DS-eca83f27-f6f5-43e0-8e25-f27ad6e108d4 node DatanodeRegistration(127.0.0.1:46325, datanodeUuid=a6411c56-34e1-44f3-a8a5-7593ae06f6ae, infoPort=44371, infoSecurePort=0, ipcPort=36687, storageInfo=lv=-57;cid=testClusterID;nsid=1165642678;c=1676261023856), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:44,511 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa354030fb8dcdee8: Processing first storage report for DS-bc0f0816-93ca-4494-8d55-9c62b4458880 from datanode a6411c56-34e1-44f3-a8a5-7593ae06f6ae 2023-02-13 04:03:44,511 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa354030fb8dcdee8: from storage DS-bc0f0816-93ca-4494-8d55-9c62b4458880 node DatanodeRegistration(127.0.0.1:46325, datanodeUuid=a6411c56-34e1-44f3-a8a5-7593ae06f6ae, infoPort=44371, infoSecurePort=0, ipcPort=36687, storageInfo=lv=-57;cid=testClusterID;nsid=1165642678;c=1676261023856), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:44,613 DEBUG [Listener at localhost/36687] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162 2023-02-13 04:03:44,619 INFO [Listener at localhost/36687] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/cluster_769789a9-472d-7750-b833-a89cbb41e651/zookeeper_0, clientPort=56899, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/cluster_769789a9-472d-7750-b833-a89cbb41e651/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/cluster_769789a9-472d-7750-b833-a89cbb41e651/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 04:03:44,622 INFO [Listener at localhost/36687] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56899 2023-02-13 04:03:44,622 INFO [Listener at localhost/36687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:44,624 INFO [Listener at localhost/36687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:44,667 INFO [Listener at localhost/36687] util.FSUtils(479): Created version file at hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b with version=8 2023-02-13 04:03:44,667 INFO [Listener at localhost/36687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:44,668 INFO [Listener at localhost/36687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:44,672 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/hbase-staging 2023-02-13 04:03:44,674 INFO [Listener at localhost/36687] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:44,674 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:44,675 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:44,675 INFO [Listener at localhost/36687] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:44,675 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:44,675 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:44,675 INFO [Listener at localhost/36687] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:44,680 INFO [Listener at localhost/36687] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34675 2023-02-13 04:03:44,681 INFO [Listener at localhost/36687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:44,682 INFO [Listener at localhost/36687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:44,683 INFO [Listener at localhost/36687] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34675 connecting to ZooKeeper ensemble=127.0.0.1:56899 2023-02-13 04:03:44,697 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:346750x0, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:44,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:34675-0x1004bd94d2c0000 connected 2023-02-13 04:03:44,776 DEBUG [Listener at localhost/36687] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:44,777 DEBUG [Listener at localhost/36687] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:44,778 DEBUG [Listener at localhost/36687] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:44,780 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34675 2023-02-13 04:03:44,782 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34675 2023-02-13 04:03:44,783 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34675 2023-02-13 04:03:44,784 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34675 2023-02-13 04:03:44,786 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34675 2023-02-13 04:03:44,786 INFO [Listener at localhost/36687] master.HMaster(439): hbase.rootdir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b, hbase.cluster.distributed=false 2023-02-13 04:03:44,806 INFO [Listener at localhost/36687] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:44,806 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:44,806 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:44,807 INFO [Listener at localhost/36687] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:44,807 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:44,807 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:44,807 INFO [Listener at localhost/36687] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:44,814 INFO [Listener at localhost/36687] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40669 2023-02-13 04:03:44,814 INFO [Listener at localhost/36687] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:03:44,816 DEBUG [Listener at localhost/36687] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:44,816 INFO [Listener at localhost/36687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:44,818 INFO [Listener at localhost/36687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:44,819 INFO [Listener at localhost/36687] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40669 connecting to ZooKeeper ensemble=127.0.0.1:56899 2023-02-13 04:03:44,834 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:406690x0, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:44,835 DEBUG [Listener at localhost/36687] zookeeper.ZKUtil(164): regionserver:406690x0, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:44,836 DEBUG [Listener at localhost/36687] zookeeper.ZKUtil(164): regionserver:406690x0, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:44,837 DEBUG [Listener at localhost/36687] zookeeper.ZKUtil(164): regionserver:406690x0, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:44,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40669-0x1004bd94d2c0001 connected 2023-02-13 04:03:44,860 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40669 2023-02-13 04:03:44,864 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40669 2023-02-13 04:03:44,865 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40669 2023-02-13 04:03:44,880 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40669 2023-02-13 04:03:44,893 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40669 2023-02-13 04:03:44,912 INFO [Listener at localhost/36687] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:44,912 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:44,912 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:44,913 INFO [Listener at localhost/36687] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:44,913 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:44,913 INFO [Listener at localhost/36687] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:44,913 INFO [Listener at localhost/36687] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:44,915 INFO [Listener at localhost/36687] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36883 2023-02-13 04:03:44,915 INFO [Listener at localhost/36687] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:03:44,929 DEBUG [Listener at localhost/36687] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:44,929 INFO [Listener at localhost/36687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:44,930 INFO [Listener at localhost/36687] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:44,932 INFO [Listener at localhost/36687] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36883 connecting to ZooKeeper ensemble=127.0.0.1:56899 2023-02-13 04:03:44,936 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:368830x0, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:44,937 DEBUG [Listener at localhost/36687] zookeeper.ZKUtil(164): regionserver:368830x0, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:44,938 DEBUG [Listener at localhost/36687] zookeeper.ZKUtil(164): regionserver:368830x0, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:44,940 DEBUG [Listener at localhost/36687] zookeeper.ZKUtil(164): regionserver:368830x0, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:44,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36883-0x1004bd94d2c0002 connected 2023-02-13 04:03:44,952 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36883 2023-02-13 04:03:44,952 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36883 2023-02-13 04:03:44,960 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36883 2023-02-13 04:03:44,968 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36883 2023-02-13 04:03:44,969 DEBUG [Listener at localhost/36687] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36883 2023-02-13 04:03:44,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34675,1676261024674 2023-02-13 04:03:44,973 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:03:44,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34675,1676261024674 2023-02-13 04:03:44,975 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:44,975 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:44,975 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:44,975 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:44,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:03:44,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34675,1676261024674 from backup master directory 2023-02-13 04:03:44,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:03:44,986 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34675,1676261024674 2023-02-13 04:03:44,986 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:44,986 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:03:44,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,34675,1676261024674 2023-02-13 04:03:45,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/hbase.id with ID: 4fe21e4a-bc81-4e7c-a094-72ef0253a798 2023-02-13 04:03:45,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:45,072 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:45,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3b93e8aa to 127.0.0.1:56899 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:45,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@9249d58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:45,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:45,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 04:03:45,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:45,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/data/master/store-tmp 2023-02-13 04:03:45,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:45,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:03:45,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:45,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:45,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:03:45,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:45,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:45,114 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261025114Disabling compacts and flushes for region at 1676261025114Disabling writes for close at 1676261025114Writing region close event to WAL at 1676261025114Closed at 1676261025114 2023-02-13 04:03:45,115 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/WALs/jenkins-hbase4.apache.org,34675,1676261024674 2023-02-13 04:03:45,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34675%2C1676261024674, suffix=, logDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/WALs/jenkins-hbase4.apache.org,34675,1676261024674, archiveDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/oldWALs, maxLogs=10 2023-02-13 04:03:45,135 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46325,DS-eca83f27-f6f5-43e0-8e25-f27ad6e108d4,DISK] 2023-02-13 04:03:45,136 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38871,DS-726db5bc-b2a3-4f50-8a88-bc6598b1fc8a,DISK] 2023-02-13 04:03:45,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/WALs/jenkins-hbase4.apache.org,34675,1676261024674/jenkins-hbase4.apache.org%2C34675%2C1676261024674.1676261025118 2023-02-13 04:03:45,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46325,DS-eca83f27-f6f5-43e0-8e25-f27ad6e108d4,DISK], DatanodeInfoWithStorage[127.0.0.1:38871,DS-726db5bc-b2a3-4f50-8a88-bc6598b1fc8a,DISK]] 2023-02-13 04:03:45,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:45,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:45,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:45,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:45,141 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:45,143 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 04:03:45,143 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 04:03:45,144 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:45,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:45,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:45,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:45,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:45,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67817434, jitterRate=0.010558515787124634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:03:45,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676261025140Initializing all the Stores at 1676261025141 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261025141Cleaning up temporary data from old regions at 1676261025146 (+5 ms)Cleaning up detritus from prior splits at 1676261025146Region opened successfully at 1676261025151 (+5 ms) 2023-02-13 04:03:45,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 04:03:45,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 04:03:45,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 04:03:45,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 04:03:45,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 04:03:45,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 04:03:45,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 04:03:45,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 04:03:45,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 04:03:45,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 04:03:45,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 04:03:45,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 04:03:45,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 04:03:45,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 04:03:45,171 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:45,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 04:03:45,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 04:03:45,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 04:03:45,174 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:45,174 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:45,174 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:45,174 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:45,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,34675,1676261024674, sessionid=0x1004bd94d2c0000, setting cluster-up flag (Was=false) 2023-02-13 04:03:45,179 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:45,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 04:03:45,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34675,1676261024674 2023-02-13 04:03:45,191 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:45,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 04:03:45,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34675,1676261024674 2023-02-13 04:03:45,198 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.hbase-snapshot/.tmp 2023-02-13 04:03:45,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:45,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:45,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:45,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:45,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:45,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 04:03:45,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:45,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676261055206 2023-02-13 04:03:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 04:03:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 04:03:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 04:03:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 04:03:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 04:03:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 04:03:45,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,207 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:45,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 04:03:45,207 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 04:03:45,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 04:03:45,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 04:03:45,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 04:03:45,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 04:03:45,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261025208,5,FailOnTimeoutGroup] 2023-02-13 04:03:45,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261025208,5,FailOnTimeoutGroup] 2023-02-13 04:03:45,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 04:03:45,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,209 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:45,218 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:45,218 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:45,219 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b 2023-02-13 04:03:45,229 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:45,232 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:03:45,233 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/info 2023-02-13 04:03:45,234 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:03:45,234 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:45,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:03:45,236 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:45,237 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:03:45,237 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:45,237 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:03:45,239 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/table 2023-02-13 04:03:45,240 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:03:45,240 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:45,241 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740 2023-02-13 04:03:45,241 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740 2023-02-13 04:03:45,244 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:03:45,245 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:03:45,247 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:45,248 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70877716, jitterRate=0.05616027116775513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:03:45,248 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676261025229Initializing all the Stores at 1676261025230 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261025230Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261025232 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261025232Cleaning up temporary data from old regions at 1676261025242 (+10 ms)Cleaning up detritus from prior splits at 1676261025243 (+1 ms)Region opened successfully at 1676261025248 (+5 ms) 2023-02-13 04:03:45,248 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:03:45,248 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:03:45,248 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:03:45,248 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:03:45,248 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:03:45,248 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:03:45,248 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261025248Disabling compacts and flushes for region at 1676261025248Disabling writes for close at 1676261025248Writing region close event to WAL at 1676261025248Closed at 1676261025248 2023-02-13 04:03:45,249 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:45,250 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 04:03:45,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 04:03:45,251 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 04:03:45,253 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 04:03:45,271 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(952): ClusterId : 4fe21e4a-bc81-4e7c-a094-72ef0253a798 2023-02-13 04:03:45,271 DEBUG [RS:1;jenkins-hbase4:36883] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:03:45,271 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(952): ClusterId : 4fe21e4a-bc81-4e7c-a094-72ef0253a798 2023-02-13 04:03:45,271 DEBUG [RS:0;jenkins-hbase4:40669] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:03:45,274 DEBUG [RS:1;jenkins-hbase4:36883] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:03:45,274 DEBUG [RS:1;jenkins-hbase4:36883] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:03:45,274 DEBUG [RS:0;jenkins-hbase4:40669] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:03:45,274 DEBUG [RS:0;jenkins-hbase4:40669] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:03:45,277 DEBUG [RS:1;jenkins-hbase4:36883] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:03:45,278 DEBUG [RS:0;jenkins-hbase4:40669] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:03:45,279 DEBUG [RS:1;jenkins-hbase4:36883] zookeeper.ReadOnlyZKClient(139): Connect 0x13ad1457 to 127.0.0.1:56899 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:45,279 DEBUG [RS:0;jenkins-hbase4:40669] zookeeper.ReadOnlyZKClient(139): Connect 0x39d379e0 to 127.0.0.1:56899 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:45,294 DEBUG [RS:0;jenkins-hbase4:40669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@371480aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:45,294 DEBUG [RS:0;jenkins-hbase4:40669] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@332b1290, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:45,296 DEBUG [RS:1;jenkins-hbase4:36883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d6af852, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:45,296 DEBUG [RS:1;jenkins-hbase4:36883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19557f27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:45,304 DEBUG [RS:0;jenkins-hbase4:40669] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40669 2023-02-13 04:03:45,304 INFO [RS:0;jenkins-hbase4:40669] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:03:45,304 INFO [RS:0;jenkins-hbase4:40669] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:03:45,304 DEBUG [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:03:45,305 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34675,1676261024674 with isa=jenkins-hbase4.apache.org/172.31.14.131:40669, startcode=1676261024805 2023-02-13 04:03:45,305 DEBUG [RS:0;jenkins-hbase4:40669] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:03:45,306 DEBUG [RS:1;jenkins-hbase4:36883] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36883 2023-02-13 04:03:45,306 INFO [RS:1;jenkins-hbase4:36883] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:03:45,306 INFO [RS:1;jenkins-hbase4:36883] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:03:45,307 DEBUG [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:03:45,308 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,34675,1676261024674 with isa=jenkins-hbase4.apache.org/172.31.14.131:36883, startcode=1676261024911 2023-02-13 04:03:45,309 DEBUG [RS:1;jenkins-hbase4:36883] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:03:45,309 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34345, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:03:45,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:45,313 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42047, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:03:45,313 DEBUG [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b 2023-02-13 04:03:45,313 DEBUG [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33645 2023-02-13 04:03:45,313 DEBUG [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:03:45,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:45,314 DEBUG [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b 2023-02-13 04:03:45,314 DEBUG [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33645 2023-02-13 04:03:45,314 DEBUG [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:03:45,316 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:45,319 DEBUG [RS:0;jenkins-hbase4:40669] zookeeper.ZKUtil(162): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:45,320 WARN [RS:0;jenkins-hbase4:40669] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:45,320 INFO [RS:0;jenkins-hbase4:40669] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:45,320 DEBUG [RS:1;jenkins-hbase4:36883] zookeeper.ZKUtil(162): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:45,320 DEBUG [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/WALs/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:45,320 WARN [RS:1;jenkins-hbase4:36883] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:45,320 INFO [RS:1;jenkins-hbase4:36883] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:45,320 DEBUG [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/WALs/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:45,333 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40669,1676261024805] 2023-02-13 04:03:45,334 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36883,1676261024911] 2023-02-13 04:03:45,343 DEBUG [RS:0;jenkins-hbase4:40669] zookeeper.ZKUtil(162): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:45,343 DEBUG [RS:1;jenkins-hbase4:36883] zookeeper.ZKUtil(162): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:45,343 DEBUG [RS:0;jenkins-hbase4:40669] zookeeper.ZKUtil(162): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:45,344 DEBUG [RS:1;jenkins-hbase4:36883] zookeeper.ZKUtil(162): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:45,344 DEBUG [RS:0;jenkins-hbase4:40669] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:03:45,345 INFO [RS:0;jenkins-hbase4:40669] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:03:45,345 DEBUG [RS:1;jenkins-hbase4:36883] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:03:45,346 INFO [RS:1;jenkins-hbase4:36883] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:03:45,347 INFO [RS:0;jenkins-hbase4:40669] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:03:45,348 INFO [RS:0;jenkins-hbase4:40669] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:03:45,348 INFO [RS:0;jenkins-hbase4:40669] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,360 INFO [RS:1;jenkins-hbase4:36883] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:03:45,370 INFO [RS:1;jenkins-hbase4:36883] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:03:45,370 INFO [RS:1;jenkins-hbase4:36883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,372 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:03:45,381 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:03:45,382 INFO [RS:0;jenkins-hbase4:40669] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,382 DEBUG [RS:0;jenkins-hbase4:40669] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,383 DEBUG [RS:0;jenkins-hbase4:40669] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,383 DEBUG [RS:0;jenkins-hbase4:40669] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,383 DEBUG [RS:0;jenkins-hbase4:40669] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,383 DEBUG [RS:0;jenkins-hbase4:40669] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,383 DEBUG [RS:0;jenkins-hbase4:40669] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:45,383 DEBUG [RS:0;jenkins-hbase4:40669] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,383 DEBUG [RS:0;jenkins-hbase4:40669] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,383 DEBUG [RS:0;jenkins-hbase4:40669] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,383 DEBUG [RS:0;jenkins-hbase4:40669] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,384 INFO [RS:1;jenkins-hbase4:36883] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,390 DEBUG [RS:1;jenkins-hbase4:36883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,390 INFO [RS:0;jenkins-hbase4:40669] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,390 DEBUG [RS:1;jenkins-hbase4:36883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,390 INFO [RS:0;jenkins-hbase4:40669] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,390 INFO [RS:0;jenkins-hbase4:40669] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,390 DEBUG [RS:1;jenkins-hbase4:36883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,390 DEBUG [RS:1;jenkins-hbase4:36883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,390 DEBUG [RS:1;jenkins-hbase4:36883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,390 DEBUG [RS:1;jenkins-hbase4:36883] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:45,390 DEBUG [RS:1;jenkins-hbase4:36883] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,390 DEBUG [RS:1;jenkins-hbase4:36883] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,390 DEBUG [RS:1;jenkins-hbase4:36883] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,390 DEBUG [RS:1;jenkins-hbase4:36883] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:45,399 INFO [RS:1;jenkins-hbase4:36883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,399 INFO [RS:1;jenkins-hbase4:36883] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,399 INFO [RS:1;jenkins-hbase4:36883] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,403 DEBUG [jenkins-hbase4:34675] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 04:03:45,403 DEBUG [jenkins-hbase4:34675] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:45,406 DEBUG [jenkins-hbase4:34675] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:45,406 DEBUG [jenkins-hbase4:34675] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:45,406 DEBUG [jenkins-hbase4:34675] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:45,406 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40669,1676261024805, state=OPENING 2023-02-13 04:03:45,407 INFO [RS:0;jenkins-hbase4:40669] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:03:45,407 INFO [RS:0;jenkins-hbase4:40669] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40669,1676261024805-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,408 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 04:03:45,414 INFO [RS:1;jenkins-hbase4:36883] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:03:45,414 INFO [RS:1;jenkins-hbase4:36883] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36883,1676261024911-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,420 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:45,420 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:03:45,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40669,1676261024805}] 2023-02-13 04:03:45,424 INFO [RS:0;jenkins-hbase4:40669] regionserver.Replication(203): jenkins-hbase4.apache.org,40669,1676261024805 started 2023-02-13 04:03:45,424 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40669,1676261024805, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40669, sessionid=0x1004bd94d2c0001 2023-02-13 04:03:45,424 DEBUG [RS:0;jenkins-hbase4:40669] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:03:45,424 DEBUG [RS:0;jenkins-hbase4:40669] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:45,424 DEBUG [RS:0;jenkins-hbase4:40669] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40669,1676261024805' 2023-02-13 04:03:45,425 DEBUG [RS:0;jenkins-hbase4:40669] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:45,425 DEBUG [RS:0;jenkins-hbase4:40669] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:45,429 DEBUG [RS:0;jenkins-hbase4:40669] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:03:45,429 DEBUG [RS:0;jenkins-hbase4:40669] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:03:45,429 DEBUG [RS:0;jenkins-hbase4:40669] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:45,429 DEBUG [RS:0;jenkins-hbase4:40669] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40669,1676261024805' 2023-02-13 04:03:45,429 DEBUG [RS:0;jenkins-hbase4:40669] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:45,430 INFO [RS:1;jenkins-hbase4:36883] regionserver.Replication(203): jenkins-hbase4.apache.org,36883,1676261024911 started 2023-02-13 04:03:45,430 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36883,1676261024911, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36883, sessionid=0x1004bd94d2c0002 2023-02-13 04:03:45,430 DEBUG [RS:1;jenkins-hbase4:36883] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:03:45,430 DEBUG [RS:1;jenkins-hbase4:36883] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:45,430 DEBUG [RS:0;jenkins-hbase4:40669] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:45,430 DEBUG [RS:1;jenkins-hbase4:36883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36883,1676261024911' 2023-02-13 04:03:45,430 DEBUG [RS:1;jenkins-hbase4:36883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:45,430 DEBUG [RS:0;jenkins-hbase4:40669] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:03:45,431 INFO [RS:0;jenkins-hbase4:40669] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:03:45,431 INFO [RS:0;jenkins-hbase4:40669] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:03:45,431 DEBUG [RS:1;jenkins-hbase4:36883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:45,431 DEBUG [RS:1;jenkins-hbase4:36883] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:03:45,431 DEBUG [RS:1;jenkins-hbase4:36883] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:03:45,431 DEBUG [RS:1;jenkins-hbase4:36883] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:45,431 DEBUG [RS:1;jenkins-hbase4:36883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36883,1676261024911' 2023-02-13 04:03:45,431 DEBUG [RS:1;jenkins-hbase4:36883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:45,431 DEBUG [RS:1;jenkins-hbase4:36883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:45,432 DEBUG [RS:1;jenkins-hbase4:36883] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:03:45,432 INFO [RS:1;jenkins-hbase4:36883] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:03:45,432 INFO [RS:1;jenkins-hbase4:36883] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:03:45,577 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:45,577 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:03:45,580 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44500, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:03:45,584 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 04:03:45,584 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:45,586 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40669%2C1676261024805.meta, suffix=.meta, logDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/WALs/jenkins-hbase4.apache.org,40669,1676261024805, archiveDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/oldWALs, maxLogs=32 2023-02-13 04:03:45,604 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46325,DS-eca83f27-f6f5-43e0-8e25-f27ad6e108d4,DISK] 2023-02-13 04:03:45,604 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38871,DS-726db5bc-b2a3-4f50-8a88-bc6598b1fc8a,DISK] 2023-02-13 04:03:45,607 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/WALs/jenkins-hbase4.apache.org,40669,1676261024805/jenkins-hbase4.apache.org%2C40669%2C1676261024805.meta.1676261025587.meta 2023-02-13 04:03:45,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46325,DS-eca83f27-f6f5-43e0-8e25-f27ad6e108d4,DISK], DatanodeInfoWithStorage[127.0.0.1:38871,DS-726db5bc-b2a3-4f50-8a88-bc6598b1fc8a,DISK]] 2023-02-13 04:03:45,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:45,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 04:03:45,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 04:03:45,612 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 04:03:45,612 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 04:03:45,612 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:45,613 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 04:03:45,613 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 04:03:45,614 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:03:45,616 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/info 2023-02-13 04:03:45,616 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/info 2023-02-13 04:03:45,616 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:03:45,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:45,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:03:45,618 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:45,618 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:45,619 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:03:45,620 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:45,620 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:03:45,621 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/table 2023-02-13 04:03:45,621 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/table 2023-02-13 04:03:45,621 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:03:45,622 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:45,623 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740 2023-02-13 04:03:45,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740 2023-02-13 04:03:45,627 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:03:45,629 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:03:45,630 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64449606, jitterRate=-0.03962603211402893}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:03:45,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676261025613Writing region info on filesystem at 1676261025613Initializing all the Stores at 1676261025614 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261025614Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261025614Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261025614Cleaning up temporary data from old regions at 1676261025626 (+12 ms)Cleaning up detritus from prior splits at 1676261025626Running coprocessor post-open hooks at 1676261025630 (+4 ms)Region opened successfully at 1676261025630 2023-02-13 04:03:45,631 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676261025576 2023-02-13 04:03:45,635 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 04:03:45,635 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 04:03:45,636 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40669,1676261024805, state=OPEN 2023-02-13 04:03:45,637 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 04:03:45,637 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:03:45,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 04:03:45,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40669,1676261024805 in 217 msec 2023-02-13 04:03:45,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 04:03:45,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 389 msec 2023-02-13 04:03:45,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 443 msec 2023-02-13 04:03:45,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676261024973, completionTime=-1 2023-02-13 04:03:45,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 04:03:45,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 04:03:45,656 DEBUG [hconnection-0x49c8f42c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:45,662 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44516, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:45,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 04:03:45,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676261085664 2023-02-13 04:03:45,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676261145664 2023-02-13 04:03:45,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 19 msec 2023-02-13 04:03:45,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34675,1676261024674-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34675,1676261024674-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34675,1676261024674-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34675, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:45,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 04:03:45,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:45,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 04:03:45,675 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 04:03:45,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:03:45,679 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:03:45,681 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d 2023-02-13 04:03:45,682 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d empty. 2023-02-13 04:03:45,683 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d 2023-02-13 04:03:45,683 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 04:03:45,700 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:45,701 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5f4061676a4cdcf751c16fc072a83c5d, NAME => 'hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:45,711 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:45,711 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 5f4061676a4cdcf751c16fc072a83c5d, disabling compactions & flushes 2023-02-13 04:03:45,711 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:45,711 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:45,711 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. after waiting 0 ms 2023-02-13 04:03:45,711 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:45,711 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:45,711 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 5f4061676a4cdcf751c16fc072a83c5d: Waiting for close lock at 1676261025711Disabling compacts and flushes for region at 1676261025711Disabling writes for close at 1676261025711Writing region close event to WAL at 1676261025711Closed at 1676261025711 2023-02-13 04:03:45,714 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:03:45,715 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261025715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261025715"}]},"ts":"1676261025715"} 2023-02-13 04:03:45,718 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:03:45,719 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:03:45,719 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261025719"}]},"ts":"1676261025719"} 2023-02-13 04:03:45,721 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 04:03:45,725 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:45,726 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:45,726 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:45,726 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:45,726 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5f4061676a4cdcf751c16fc072a83c5d, ASSIGN}] 2023-02-13 04:03:45,729 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5f4061676a4cdcf751c16fc072a83c5d, ASSIGN 2023-02-13 04:03:45,730 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5f4061676a4cdcf751c16fc072a83c5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36883,1676261024911; forceNewPlan=false, retain=false 2023-02-13 04:03:45,880 INFO [jenkins-hbase4:34675] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:03:45,881 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5f4061676a4cdcf751c16fc072a83c5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:45,881 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261025881"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261025881"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261025881"}]},"ts":"1676261025881"} 2023-02-13 04:03:45,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5f4061676a4cdcf751c16fc072a83c5d, server=jenkins-hbase4.apache.org,36883,1676261024911}] 2023-02-13 04:03:46,037 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:46,038 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:03:46,040 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58552, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:03:46,045 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:46,046 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36883%2C1676261024911, suffix=, logDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/WALs/jenkins-hbase4.apache.org,36883,1676261024911, archiveDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/oldWALs, maxLogs=32 2023-02-13 04:03:46,065 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38871,DS-726db5bc-b2a3-4f50-8a88-bc6598b1fc8a,DISK] 2023-02-13 04:03:46,067 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46325,DS-eca83f27-f6f5-43e0-8e25-f27ad6e108d4,DISK] 2023-02-13 04:03:46,069 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/WALs/jenkins-hbase4.apache.org,36883,1676261024911/jenkins-hbase4.apache.org%2C36883%2C1676261024911.1676261026047 2023-02-13 04:03:46,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38871,DS-726db5bc-b2a3-4f50-8a88-bc6598b1fc8a,DISK], DatanodeInfoWithStorage[127.0.0.1:46325,DS-eca83f27-f6f5-43e0-8e25-f27ad6e108d4,DISK]] 2023-02-13 04:03:46,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5f4061676a4cdcf751c16fc072a83c5d, NAME => 'hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:46,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5f4061676a4cdcf751c16fc072a83c5d 2023-02-13 04:03:46,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5f4061676a4cdcf751c16fc072a83c5d 2023-02-13 04:03:46,069 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5f4061676a4cdcf751c16fc072a83c5d 2023-02-13 04:03:46,071 INFO [StoreOpener-5f4061676a4cdcf751c16fc072a83c5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5f4061676a4cdcf751c16fc072a83c5d 2023-02-13 04:03:46,072 DEBUG [StoreOpener-5f4061676a4cdcf751c16fc072a83c5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d/info 2023-02-13 04:03:46,072 DEBUG [StoreOpener-5f4061676a4cdcf751c16fc072a83c5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d/info 2023-02-13 04:03:46,073 INFO [StoreOpener-5f4061676a4cdcf751c16fc072a83c5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f4061676a4cdcf751c16fc072a83c5d columnFamilyName info 2023-02-13 04:03:46,073 INFO [StoreOpener-5f4061676a4cdcf751c16fc072a83c5d-1] regionserver.HStore(310): Store=5f4061676a4cdcf751c16fc072a83c5d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:46,074 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d 2023-02-13 04:03:46,074 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d 2023-02-13 04:03:46,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5f4061676a4cdcf751c16fc072a83c5d 2023-02-13 04:03:46,079 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:46,080 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5f4061676a4cdcf751c16fc072a83c5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67780667, jitterRate=0.010010644793510437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:03:46,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5f4061676a4cdcf751c16fc072a83c5d: Running coprocessor pre-open hook at 1676261026070Writing region info on filesystem at 1676261026070Initializing all the Stores at 1676261026070Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261026070Cleaning up temporary data from old regions at 1676261026075 (+5 ms)Cleaning up detritus from prior splits at 1676261026075Running coprocessor post-open hooks at 1676261026080 (+5 ms)Region opened successfully at 1676261026080 2023-02-13 04:03:46,080 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d., pid=6, masterSystemTime=1676261026037 2023-02-13 04:03:46,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:46,085 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5f4061676a4cdcf751c16fc072a83c5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:46,086 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261026085"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261026085"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261026085"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261026085"}]},"ts":"1676261026085"} 2023-02-13 04:03:46,087 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:46,090 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 04:03:46,090 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5f4061676a4cdcf751c16fc072a83c5d, server=jenkins-hbase4.apache.org,36883,1676261024911 in 204 msec 2023-02-13 04:03:46,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 04:03:46,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5f4061676a4cdcf751c16fc072a83c5d, ASSIGN in 364 msec 2023-02-13 04:03:46,093 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:03:46,093 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261026093"}]},"ts":"1676261026093"} 2023-02-13 04:03:46,095 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 04:03:46,097 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:03:46,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 425 msec 2023-02-13 04:03:46,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 04:03:46,175 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:46,176 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:46,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:46,182 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58568, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:46,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 04:03:46,195 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:46,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-13 04:03:46,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 04:03:46,216 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:46,220 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-13 04:03:46,233 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 04:03:46,235 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 04:03:46,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.249sec 2023-02-13 04:03:46,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 04:03:46,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 04:03:46,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 04:03:46,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34675,1676261024674-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 04:03:46,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34675,1676261024674-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 04:03:46,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 04:03:46,272 DEBUG [Listener at localhost/36687] zookeeper.ReadOnlyZKClient(139): Connect 0x0e13a120 to 127.0.0.1:56899 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:46,278 DEBUG [Listener at localhost/36687] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f08c7d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:46,279 DEBUG [hconnection-0x1bf6ee94-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:46,282 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44530, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:46,283 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34675,1676261024674 2023-02-13 04:03:46,284 DEBUG [Listener at localhost/36687] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 04:03:46,286 DEBUG [Listener at localhost/36687] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:03:46,288 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59384, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:03:46,294 INFO [Listener at localhost/36687] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 04:03:46,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 04:03:46,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 04:03:46,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:59384 deadline: 1676261086295, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 04:03:46,296 INFO [Listener at localhost/36687] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 04:03:46,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:46,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 04:03:46,301 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:03:46,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 04:03:46,302 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:03:46,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:46,312 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:46,312 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:46,312 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:46,312 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:46,312 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:46,313 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:46,313 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:46,313 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:46,313 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028 empty. 2023-02-13 04:03:46,313 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259 empty. 2023-02-13 04:03:46,313 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7 empty. 2023-02-13 04:03:46,313 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f empty. 2023-02-13 04:03:46,313 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12 empty. 2023-02-13 04:03:46,313 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3 empty. 2023-02-13 04:03:46,313 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b empty. 2023-02-13 04:03:46,314 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:46,314 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e empty. 2023-02-13 04:03:46,314 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:46,314 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:46,314 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:46,314 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:46,314 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:46,314 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:46,314 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:46,315 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:46,315 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:46,315 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe empty. 2023-02-13 04:03:46,315 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d empty. 2023-02-13 04:03:46,315 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:46,315 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:46,315 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 04:03:46,327 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:46,328 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 86cc148bad996fa54a1262ed289ea06f, NAME => 'testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:46,329 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 44fcb2a197fd68783177ef7b01cbd259, NAME => 'testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:46,329 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => cc7353a5827a0568b6ae928dd1077028, NAME => 'testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:46,340 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,340 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 86cc148bad996fa54a1262ed289ea06f, disabling compactions & flushes 2023-02-13 04:03:46,340 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:46,340 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:46,341 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. after waiting 0 ms 2023-02-13 04:03:46,341 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:46,341 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:46,341 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 86cc148bad996fa54a1262ed289ea06f: Waiting for close lock at 1676261026340Disabling compacts and flushes for region at 1676261026340Disabling writes for close at 1676261026341 (+1 ms)Writing region close event to WAL at 1676261026341Closed at 1676261026341 2023-02-13 04:03:46,341 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 62f7f3bc3f20c01c645d954e3b69abb7, NAME => 'testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:46,355 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing cc7353a5827a0568b6ae928dd1077028, disabling compactions & flushes 2023-02-13 04:03:46,356 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:46,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:46,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. after waiting 0 ms 2023-02-13 04:03:46,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:46,356 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:46,356 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for cc7353a5827a0568b6ae928dd1077028: Waiting for close lock at 1676261026356Disabling compacts and flushes for region at 1676261026356Disabling writes for close at 1676261026356Writing region close event to WAL at 1676261026356Closed at 1676261026356 2023-02-13 04:03:46,356 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3e263c48eebc5aa48ed5c2a4a4863a12, NAME => 'testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:46,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 44fcb2a197fd68783177ef7b01cbd259, disabling compactions & flushes 2023-02-13 04:03:46,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:46,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:46,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. after waiting 0 ms 2023-02-13 04:03:46,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:46,357 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:46,357 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 44fcb2a197fd68783177ef7b01cbd259: Waiting for close lock at 1676261026357Disabling compacts and flushes for region at 1676261026357Disabling writes for close at 1676261026357Writing region close event to WAL at 1676261026357Closed at 1676261026357 2023-02-13 04:03:46,358 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a6aa62f8f30de3b31afd96d5c1977ff3, NAME => 'testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:46,363 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,363 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 62f7f3bc3f20c01c645d954e3b69abb7, disabling compactions & flushes 2023-02-13 04:03:46,363 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:46,363 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:46,363 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. after waiting 0 ms 2023-02-13 04:03:46,363 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:46,363 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:46,363 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 62f7f3bc3f20c01c645d954e3b69abb7: Waiting for close lock at 1676261026363Disabling compacts and flushes for region at 1676261026363Disabling writes for close at 1676261026363Writing region close event to WAL at 1676261026363Closed at 1676261026363 2023-02-13 04:03:46,364 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => c755ff97300fd153ac6e002461facc3e, NAME => 'testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:46,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 3e263c48eebc5aa48ed5c2a4a4863a12, disabling compactions & flushes 2023-02-13 04:03:46,368 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:46,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:46,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. after waiting 0 ms 2023-02-13 04:03:46,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:46,368 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:46,368 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 3e263c48eebc5aa48ed5c2a4a4863a12: Waiting for close lock at 1676261026368Disabling compacts and flushes for region at 1676261026368Disabling writes for close at 1676261026368Writing region close event to WAL at 1676261026368Closed at 1676261026368 2023-02-13 04:03:46,369 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 47629f72f274f163d1ab72258ac4bb3b, NAME => 'testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:46,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a6aa62f8f30de3b31afd96d5c1977ff3, disabling compactions & flushes 2023-02-13 04:03:46,377 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:46,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:46,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. after waiting 0 ms 2023-02-13 04:03:46,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:46,377 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:46,377 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a6aa62f8f30de3b31afd96d5c1977ff3: Waiting for close lock at 1676261026377Disabling compacts and flushes for region at 1676261026377Disabling writes for close at 1676261026377Writing region close event to WAL at 1676261026377Closed at 1676261026377 2023-02-13 04:03:46,378 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4f5dd40c4622943c4fb4af1a2a0ba82d, NAME => 'testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:46,388 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,388 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing c755ff97300fd153ac6e002461facc3e, disabling compactions & flushes 2023-02-13 04:03:46,388 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:46,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:46,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. after waiting 0 ms 2023-02-13 04:03:46,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:46,389 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:46,389 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for c755ff97300fd153ac6e002461facc3e: Waiting for close lock at 1676261026388Disabling compacts and flushes for region at 1676261026388Disabling writes for close at 1676261026389 (+1 ms)Writing region close event to WAL at 1676261026389Closed at 1676261026389 2023-02-13 04:03:46,389 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 144c9cc6bb8fb7be885f286b99927ebe, NAME => 'testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.tmp 2023-02-13 04:03:46,392 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,392 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 47629f72f274f163d1ab72258ac4bb3b, disabling compactions & flushes 2023-02-13 04:03:46,392 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:46,392 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:46,392 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. after waiting 0 ms 2023-02-13 04:03:46,392 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:46,392 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:46,392 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 47629f72f274f163d1ab72258ac4bb3b: Waiting for close lock at 1676261026392Disabling compacts and flushes for region at 1676261026392Disabling writes for close at 1676261026392Writing region close event to WAL at 1676261026392Closed at 1676261026392 2023-02-13 04:03:46,397 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,397 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 144c9cc6bb8fb7be885f286b99927ebe, disabling compactions & flushes 2023-02-13 04:03:46,397 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:46,397 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:46,398 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. after waiting 0 ms 2023-02-13 04:03:46,398 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:46,398 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:46,398 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 144c9cc6bb8fb7be885f286b99927ebe: Waiting for close lock at 1676261026397Disabling compacts and flushes for region at 1676261026397Disabling writes for close at 1676261026398 (+1 ms)Writing region close event to WAL at 1676261026398Closed at 1676261026398 2023-02-13 04:03:46,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:46,433 INFO [RS:0;jenkins-hbase4:40669] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40669%2C1676261024805, suffix=, logDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/WALs/jenkins-hbase4.apache.org,40669,1676261024805, archiveDir=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/oldWALs, maxLogs=32 2023-02-13 04:03:46,449 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38871,DS-726db5bc-b2a3-4f50-8a88-bc6598b1fc8a,DISK] 2023-02-13 04:03:46,450 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46325,DS-eca83f27-f6f5-43e0-8e25-f27ad6e108d4,DISK] 2023-02-13 04:03:46,452 INFO [RS:0;jenkins-hbase4:40669] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/WALs/jenkins-hbase4.apache.org,40669,1676261024805/jenkins-hbase4.apache.org%2C40669%2C1676261024805.1676261026433 2023-02-13 04:03:46,453 DEBUG [RS:0;jenkins-hbase4:40669] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38871,DS-726db5bc-b2a3-4f50-8a88-bc6598b1fc8a,DISK], DatanodeInfoWithStorage[127.0.0.1:46325,DS-eca83f27-f6f5-43e0-8e25-f27ad6e108d4,DISK]] 2023-02-13 04:03:46,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:46,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:46,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4f5dd40c4622943c4fb4af1a2a0ba82d, disabling compactions & flushes 2023-02-13 04:03:46,791 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:46,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:46,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. after waiting 0 ms 2023-02-13 04:03:46,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:46,791 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:46,791 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4f5dd40c4622943c4fb4af1a2a0ba82d: Waiting for close lock at 1676261026791Disabling compacts and flushes for region at 1676261026791Disabling writes for close at 1676261026791Writing region close event to WAL at 1676261026791Closed at 1676261026791 2023-02-13 04:03:46,794 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:03:46,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261026795"}]},"ts":"1676261026795"} 2023-02-13 04:03:46,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261026795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261026795"}]},"ts":"1676261026795"} 2023-02-13 04:03:46,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261026795"}]},"ts":"1676261026795"} 2023-02-13 04:03:46,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261026795"}]},"ts":"1676261026795"} 2023-02-13 04:03:46,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261026795"}]},"ts":"1676261026795"} 2023-02-13 04:03:46,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261026795"}]},"ts":"1676261026795"} 2023-02-13 04:03:46,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261026795"}]},"ts":"1676261026795"} 2023-02-13 04:03:46,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261026795"}]},"ts":"1676261026795"} 2023-02-13 04:03:46,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261026795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261026795"}]},"ts":"1676261026795"} 2023-02-13 04:03:46,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261026795"}]},"ts":"1676261026795"} 2023-02-13 04:03:46,799 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 04:03:46,801 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:03:46,801 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261026801"}]},"ts":"1676261026801"} 2023-02-13 04:03:46,802 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 04:03:46,805 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:46,814 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:46,814 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:46,814 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:46,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cc7353a5827a0568b6ae928dd1077028, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=44fcb2a197fd68783177ef7b01cbd259, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=86cc148bad996fa54a1262ed289ea06f, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=62f7f3bc3f20c01c645d954e3b69abb7, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3e263c48eebc5aa48ed5c2a4a4863a12, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a6aa62f8f30de3b31afd96d5c1977ff3, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c755ff97300fd153ac6e002461facc3e, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=47629f72f274f163d1ab72258ac4bb3b, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4f5dd40c4622943c4fb4af1a2a0ba82d, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=144c9cc6bb8fb7be885f286b99927ebe, ASSIGN}] 2023-02-13 04:03:46,818 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=144c9cc6bb8fb7be885f286b99927ebe, ASSIGN 2023-02-13 04:03:46,818 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=47629f72f274f163d1ab72258ac4bb3b, ASSIGN 2023-02-13 04:03:46,818 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4f5dd40c4622943c4fb4af1a2a0ba82d, ASSIGN 2023-02-13 04:03:46,818 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c755ff97300fd153ac6e002461facc3e, ASSIGN 2023-02-13 04:03:46,818 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a6aa62f8f30de3b31afd96d5c1977ff3, ASSIGN 2023-02-13 04:03:46,819 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=144c9cc6bb8fb7be885f286b99927ebe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40669,1676261024805; forceNewPlan=false, retain=false 2023-02-13 04:03:46,819 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=47629f72f274f163d1ab72258ac4bb3b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36883,1676261024911; forceNewPlan=false, retain=false 2023-02-13 04:03:46,820 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a6aa62f8f30de3b31afd96d5c1977ff3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36883,1676261024911; forceNewPlan=false, retain=false 2023-02-13 04:03:46,820 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c755ff97300fd153ac6e002461facc3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40669,1676261024805; forceNewPlan=false, retain=false 2023-02-13 04:03:46,820 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4f5dd40c4622943c4fb4af1a2a0ba82d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36883,1676261024911; forceNewPlan=false, retain=false 2023-02-13 04:03:46,819 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3e263c48eebc5aa48ed5c2a4a4863a12, ASSIGN 2023-02-13 04:03:46,821 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=62f7f3bc3f20c01c645d954e3b69abb7, ASSIGN 2023-02-13 04:03:46,821 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=86cc148bad996fa54a1262ed289ea06f, ASSIGN 2023-02-13 04:03:46,821 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3e263c48eebc5aa48ed5c2a4a4863a12, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40669,1676261024805; forceNewPlan=false, retain=false 2023-02-13 04:03:46,821 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=44fcb2a197fd68783177ef7b01cbd259, ASSIGN 2023-02-13 04:03:46,821 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cc7353a5827a0568b6ae928dd1077028, ASSIGN 2023-02-13 04:03:46,822 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=62f7f3bc3f20c01c645d954e3b69abb7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36883,1676261024911; forceNewPlan=false, retain=false 2023-02-13 04:03:46,822 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=86cc148bad996fa54a1262ed289ea06f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40669,1676261024805; forceNewPlan=false, retain=false 2023-02-13 04:03:46,822 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=44fcb2a197fd68783177ef7b01cbd259, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40669,1676261024805; forceNewPlan=false, retain=false 2023-02-13 04:03:46,823 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cc7353a5827a0568b6ae928dd1077028, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36883,1676261024911; forceNewPlan=false, retain=false 2023-02-13 04:03:46,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:46,969 INFO [jenkins-hbase4:34675] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 04:03:46,972 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=86cc148bad996fa54a1262ed289ea06f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:46,972 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=144c9cc6bb8fb7be885f286b99927ebe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:46,972 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3e263c48eebc5aa48ed5c2a4a4863a12, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:46,972 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=44fcb2a197fd68783177ef7b01cbd259, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:46,972 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c755ff97300fd153ac6e002461facc3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:46,973 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261026972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261026972"}]},"ts":"1676261026972"} 2023-02-13 04:03:46,973 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261026972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261026972"}]},"ts":"1676261026972"} 2023-02-13 04:03:46,973 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261026972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261026972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261026972"}]},"ts":"1676261026972"} 2023-02-13 04:03:46,973 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261026972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261026972"}]},"ts":"1676261026972"} 2023-02-13 04:03:46,973 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261026972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261026972"}]},"ts":"1676261026972"} 2023-02-13 04:03:46,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=12, state=RUNNABLE; OpenRegionProcedure 44fcb2a197fd68783177ef7b01cbd259, server=jenkins-hbase4.apache.org,40669,1676261024805}] 2023-02-13 04:03:46,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure 86cc148bad996fa54a1262ed289ea06f, server=jenkins-hbase4.apache.org,40669,1676261024805}] 2023-02-13 04:03:46,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure 144c9cc6bb8fb7be885f286b99927ebe, server=jenkins-hbase4.apache.org,40669,1676261024805}] 2023-02-13 04:03:46,981 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cc7353a5827a0568b6ae928dd1077028, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:46,981 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261026981"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261026981"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261026981"}]},"ts":"1676261026981"} 2023-02-13 04:03:46,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure c755ff97300fd153ac6e002461facc3e, server=jenkins-hbase4.apache.org,40669,1676261024805}] 2023-02-13 04:03:46,986 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=15, state=RUNNABLE; OpenRegionProcedure 3e263c48eebc5aa48ed5c2a4a4863a12, server=jenkins-hbase4.apache.org,40669,1676261024805}] 2023-02-13 04:03:46,986 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=47629f72f274f163d1ab72258ac4bb3b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:46,986 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4f5dd40c4622943c4fb4af1a2a0ba82d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:46,986 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261026986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261026986"}]},"ts":"1676261026986"} 2023-02-13 04:03:46,986 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261026986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261026986"}]},"ts":"1676261026986"} 2023-02-13 04:03:46,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=11, state=RUNNABLE; OpenRegionProcedure cc7353a5827a0568b6ae928dd1077028, server=jenkins-hbase4.apache.org,36883,1676261024911}] 2023-02-13 04:03:46,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure 47629f72f274f163d1ab72258ac4bb3b, server=jenkins-hbase4.apache.org,36883,1676261024911}] 2023-02-13 04:03:46,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 4f5dd40c4622943c4fb4af1a2a0ba82d, server=jenkins-hbase4.apache.org,36883,1676261024911}] 2023-02-13 04:03:46,993 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a6aa62f8f30de3b31afd96d5c1977ff3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:46,993 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026993"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261026993"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261026993"}]},"ts":"1676261026993"} 2023-02-13 04:03:46,994 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=62f7f3bc3f20c01c645d954e3b69abb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:46,995 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261026994"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261026994"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261026994"}]},"ts":"1676261026994"} 2023-02-13 04:03:46,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure a6aa62f8f30de3b31afd96d5c1977ff3, server=jenkins-hbase4.apache.org,36883,1676261024911}] 2023-02-13 04:03:46,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=14, state=RUNNABLE; OpenRegionProcedure 62f7f3bc3f20c01c645d954e3b69abb7, server=jenkins-hbase4.apache.org,36883,1676261024911}] 2023-02-13 04:03:47,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:47,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4f5dd40c4622943c4fb4af1a2a0ba82d, NAME => 'testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 04:03:47,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:47,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:47,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:47,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:47,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:47,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 44fcb2a197fd68783177ef7b01cbd259, NAME => 'testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 04:03:47,152 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:47,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:47,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:47,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:47,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:47,153 DEBUG [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f1 2023-02-13 04:03:47,153 DEBUG [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f1 2023-02-13 04:03:47,154 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f5dd40c4622943c4fb4af1a2a0ba82d columnFamilyName f1 2023-02-13 04:03:47,154 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] regionserver.HStore(310): Store=4f5dd40c4622943c4fb4af1a2a0ba82d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,155 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:47,156 DEBUG [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f2 2023-02-13 04:03:47,156 DEBUG [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f2 2023-02-13 04:03:47,156 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:47,156 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f5dd40c4622943c4fb4af1a2a0ba82d columnFamilyName f2 2023-02-13 04:03:47,157 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] regionserver.HStore(310): Store=4f5dd40c4622943c4fb4af1a2a0ba82d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,157 DEBUG [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f1 2023-02-13 04:03:47,158 DEBUG [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f1 2023-02-13 04:03:47,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:47,158 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44fcb2a197fd68783177ef7b01cbd259 columnFamilyName f1 2023-02-13 04:03:47,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:47,158 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] regionserver.HStore(310): Store=44fcb2a197fd68783177ef7b01cbd259/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,159 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:47,160 DEBUG [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f2 2023-02-13 04:03:47,160 DEBUG [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f2 2023-02-13 04:03:47,161 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44fcb2a197fd68783177ef7b01cbd259 columnFamilyName f2 2023-02-13 04:03:47,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:47,161 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] regionserver.HStore(310): Store=44fcb2a197fd68783177ef7b01cbd259/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:47,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:47,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:47,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:47,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:47,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4f5dd40c4622943c4fb4af1a2a0ba82d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62612355, jitterRate=-0.06700320541858673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:47,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4f5dd40c4622943c4fb4af1a2a0ba82d: Running coprocessor pre-open hook at 1676261027150Writing region info on filesystem at 1676261027150Initializing all the Stores at 1676261027151 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027151Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027151Cleaning up temporary data from old regions at 1676261027159 (+8 ms)Cleaning up detritus from prior splits at 1676261027160 (+1 ms)Running coprocessor post-open hooks at 1676261027166 (+6 ms)Region opened successfully at 1676261027166 2023-02-13 04:03:47,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:47,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d., pid=28, masterSystemTime=1676261027142 2023-02-13 04:03:47,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:47,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:47,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:47,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 44fcb2a197fd68783177ef7b01cbd259; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72700796, jitterRate=0.08332628011703491}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:47,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:47,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 44fcb2a197fd68783177ef7b01cbd259: Running coprocessor pre-open hook at 1676261027152Writing region info on filesystem at 1676261027152Initializing all the Stores at 1676261027153 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027153Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027156 (+3 ms)Cleaning up temporary data from old regions at 1676261027164 (+8 ms)Cleaning up detritus from prior splits at 1676261027164Running coprocessor post-open hooks at 1676261027170 (+6 ms)Region opened successfully at 1676261027170 2023-02-13 04:03:47,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 47629f72f274f163d1ab72258ac4bb3b, NAME => 'testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 04:03:47,170 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4f5dd40c4622943c4fb4af1a2a0ba82d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:47,171 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261027170"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261027170"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261027170"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261027170"}]},"ts":"1676261027170"} 2023-02-13 04:03:47,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:47,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:47,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:47,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259., pid=21, masterSystemTime=1676261027148 2023-02-13 04:03:47,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:47,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:47,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:47,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3e263c48eebc5aa48ed5c2a4a4863a12, NAME => 'testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 04:03:47,174 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=44fcb2a197fd68783177ef7b01cbd259, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,174 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261027174"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261027174"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261027174"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261027174"}]},"ts":"1676261027174"} 2023-02-13 04:03:47,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:47,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:47,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:47,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:47,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-13 04:03:47,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 4f5dd40c4622943c4fb4af1a2a0ba82d, server=jenkins-hbase4.apache.org,36883,1676261024911 in 180 msec 2023-02-13 04:03:47,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4f5dd40c4622943c4fb4af1a2a0ba82d, ASSIGN in 361 msec 2023-02-13 04:03:47,180 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:47,180 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:47,182 DEBUG [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f1 2023-02-13 04:03:47,182 DEBUG [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f1 2023-02-13 04:03:47,182 DEBUG [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f1 2023-02-13 04:03:47,182 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47629f72f274f163d1ab72258ac4bb3b columnFamilyName f1 2023-02-13 04:03:47,182 DEBUG [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f1 2023-02-13 04:03:47,183 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e263c48eebc5aa48ed5c2a4a4863a12 columnFamilyName f1 2023-02-13 04:03:47,183 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] regionserver.HStore(310): Store=47629f72f274f163d1ab72258ac4bb3b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,183 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:47,183 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] regionserver.HStore(310): Store=3e263c48eebc5aa48ed5c2a4a4863a12/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,184 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:47,186 DEBUG [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f2 2023-02-13 04:03:47,186 DEBUG [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f2 2023-02-13 04:03:47,186 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47629f72f274f163d1ab72258ac4bb3b columnFamilyName f2 2023-02-13 04:03:47,186 DEBUG [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f2 2023-02-13 04:03:47,186 DEBUG [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f2 2023-02-13 04:03:47,186 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e263c48eebc5aa48ed5c2a4a4863a12 columnFamilyName f2 2023-02-13 04:03:47,187 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] regionserver.HStore(310): Store=47629f72f274f163d1ab72258ac4bb3b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,187 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] regionserver.HStore(310): Store=3e263c48eebc5aa48ed5c2a4a4863a12/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:47,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:47,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:47,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:47,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:47,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:47,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=12 2023-02-13 04:03:47,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=12, state=SUCCESS; OpenRegionProcedure 44fcb2a197fd68783177ef7b01cbd259, server=jenkins-hbase4.apache.org,40669,1676261024805 in 215 msec 2023-02-13 04:03:47,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:47,194 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=44fcb2a197fd68783177ef7b01cbd259, ASSIGN in 377 msec 2023-02-13 04:03:47,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:47,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:47,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 47629f72f274f163d1ab72258ac4bb3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75363108, jitterRate=0.12299782037734985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:47,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 47629f72f274f163d1ab72258ac4bb3b: Running coprocessor pre-open hook at 1676261027171Writing region info on filesystem at 1676261027171Initializing all the Stores at 1676261027173 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027173Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027180 (+7 ms)Cleaning up temporary data from old regions at 1676261027189 (+9 ms)Cleaning up detritus from prior splits at 1676261027189Running coprocessor post-open hooks at 1676261027196 (+7 ms)Region opened successfully at 1676261027196 2023-02-13 04:03:47,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b., pid=27, masterSystemTime=1676261027142 2023-02-13 04:03:47,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:47,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3e263c48eebc5aa48ed5c2a4a4863a12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59789120, jitterRate=-0.10907268524169922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:47,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3e263c48eebc5aa48ed5c2a4a4863a12: Running coprocessor pre-open hook at 1676261027175Writing region info on filesystem at 1676261027175Initializing all the Stores at 1676261027176 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027176Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027180 (+4 ms)Cleaning up temporary data from old regions at 1676261027192 (+12 ms)Cleaning up detritus from prior splits at 1676261027193 (+1 ms)Running coprocessor post-open hooks at 1676261027198 (+5 ms)Region opened successfully at 1676261027198 2023-02-13 04:03:47,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:47,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:47,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:47,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a6aa62f8f30de3b31afd96d5c1977ff3, NAME => 'testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 04:03:47,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:47,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:47,199 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=47629f72f274f163d1ab72258ac4bb3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:47,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:47,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12., pid=25, masterSystemTime=1676261027148 2023-02-13 04:03:47,200 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261027199"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261027199"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261027199"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261027199"}]},"ts":"1676261027199"} 2023-02-13 04:03:47,200 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:47,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:47,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:47,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:47,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c755ff97300fd153ac6e002461facc3e, NAME => 'testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 04:03:47,202 DEBUG [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f1 2023-02-13 04:03:47,202 DEBUG [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f1 2023-02-13 04:03:47,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:47,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:47,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:47,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:47,202 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6aa62f8f30de3b31afd96d5c1977ff3 columnFamilyName f1 2023-02-13 04:03:47,203 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=3e263c48eebc5aa48ed5c2a4a4863a12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,203 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261027202"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261027202"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261027202"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261027202"}]},"ts":"1676261027202"} 2023-02-13 04:03:47,203 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] regionserver.HStore(310): Store=a6aa62f8f30de3b31afd96d5c1977ff3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,203 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:47,205 DEBUG [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f2 2023-02-13 04:03:47,206 DEBUG [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f2 2023-02-13 04:03:47,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-13 04:03:47,206 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure 47629f72f274f163d1ab72258ac4bb3b, server=jenkins-hbase4.apache.org,36883,1676261024911 in 210 msec 2023-02-13 04:03:47,206 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6aa62f8f30de3b31afd96d5c1977ff3 columnFamilyName f2 2023-02-13 04:03:47,207 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] regionserver.HStore(310): Store=a6aa62f8f30de3b31afd96d5c1977ff3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=15 2023-02-13 04:03:47,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=47629f72f274f163d1ab72258ac4bb3b, ASSIGN in 391 msec 2023-02-13 04:03:47,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=15, state=SUCCESS; OpenRegionProcedure 3e263c48eebc5aa48ed5c2a4a4863a12, server=jenkins-hbase4.apache.org,40669,1676261024805 in 219 msec 2023-02-13 04:03:47,208 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:47,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:47,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3e263c48eebc5aa48ed5c2a4a4863a12, ASSIGN in 392 msec 2023-02-13 04:03:47,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:47,210 DEBUG [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f1 2023-02-13 04:03:47,210 DEBUG [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f1 2023-02-13 04:03:47,210 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c755ff97300fd153ac6e002461facc3e columnFamilyName f1 2023-02-13 04:03:47,211 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] regionserver.HStore(310): Store=c755ff97300fd153ac6e002461facc3e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,211 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:47,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:47,212 DEBUG [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f2 2023-02-13 04:03:47,213 DEBUG [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f2 2023-02-13 04:03:47,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:47,213 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c755ff97300fd153ac6e002461facc3e columnFamilyName f2 2023-02-13 04:03:47,214 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] regionserver.HStore(310): Store=c755ff97300fd153ac6e002461facc3e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:47,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:47,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:47,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a6aa62f8f30de3b31afd96d5c1977ff3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69833246, jitterRate=0.040596455335617065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:47,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a6aa62f8f30de3b31afd96d5c1977ff3: Running coprocessor pre-open hook at 1676261027199Writing region info on filesystem at 1676261027199Initializing all the Stores at 1676261027200 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027200Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027200Cleaning up temporary data from old regions at 1676261027210 (+10 ms)Cleaning up detritus from prior splits at 1676261027210Running coprocessor post-open hooks at 1676261027221 (+11 ms)Region opened successfully at 1676261027221 2023-02-13 04:03:47,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3., pid=29, masterSystemTime=1676261027142 2023-02-13 04:03:47,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:47,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:47,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:47,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:47,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cc7353a5827a0568b6ae928dd1077028, NAME => 'testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 04:03:47,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:47,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:47,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:47,225 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a6aa62f8f30de3b31afd96d5c1977ff3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:47,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:47,225 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261027225"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261027225"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261027225"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261027225"}]},"ts":"1676261027225"} 2023-02-13 04:03:47,226 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:47,228 DEBUG [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028/f1 2023-02-13 04:03:47,228 DEBUG [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028/f1 2023-02-13 04:03:47,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:47,229 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-13 04:03:47,229 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure a6aa62f8f30de3b31afd96d5c1977ff3, server=jenkins-hbase4.apache.org,36883,1676261024911 in 231 msec 2023-02-13 04:03:47,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c755ff97300fd153ac6e002461facc3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66941244, jitterRate=-0.002497732639312744}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:47,230 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc7353a5827a0568b6ae928dd1077028 columnFamilyName f1 2023-02-13 04:03:47,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c755ff97300fd153ac6e002461facc3e: Running coprocessor pre-open hook at 1676261027202Writing region info on filesystem at 1676261027202Initializing all the Stores at 1676261027203 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027203Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027208 (+5 ms)Cleaning up temporary data from old regions at 1676261027222 (+14 ms)Cleaning up detritus from prior splits at 1676261027222Running coprocessor post-open hooks at 1676261027230 (+8 ms)Region opened successfully at 1676261027230 2023-02-13 04:03:47,231 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] regionserver.HStore(310): Store=cc7353a5827a0568b6ae928dd1077028/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e., pid=24, masterSystemTime=1676261027148 2023-02-13 04:03:47,231 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:47,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a6aa62f8f30de3b31afd96d5c1977ff3, ASSIGN in 414 msec 2023-02-13 04:03:47,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:47,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:47,233 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c755ff97300fd153ac6e002461facc3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:47,234 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261027233"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261027233"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261027233"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261027233"}]},"ts":"1676261027233"} 2023-02-13 04:03:47,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 86cc148bad996fa54a1262ed289ea06f, NAME => 'testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 04:03:47,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:47,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:47,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:47,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:47,235 DEBUG [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028/f2 2023-02-13 04:03:47,235 DEBUG [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028/f2 2023-02-13 04:03:47,235 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:47,236 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc7353a5827a0568b6ae928dd1077028 columnFamilyName f2 2023-02-13 04:03:47,236 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] regionserver.HStore(310): Store=cc7353a5827a0568b6ae928dd1077028/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:47,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-13 04:03:47,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure c755ff97300fd153ac6e002461facc3e, server=jenkins-hbase4.apache.org,40669,1676261024805 in 250 msec 2023-02-13 04:03:47,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:47,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c755ff97300fd153ac6e002461facc3e, ASSIGN in 422 msec 2023-02-13 04:03:47,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:47,241 DEBUG [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f1 2023-02-13 04:03:47,241 DEBUG [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f1 2023-02-13 04:03:47,241 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86cc148bad996fa54a1262ed289ea06f columnFamilyName f1 2023-02-13 04:03:47,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:47,242 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] regionserver.HStore(310): Store=86cc148bad996fa54a1262ed289ea06f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,243 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:47,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:47,244 DEBUG [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f2 2023-02-13 04:03:47,244 DEBUG [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f2 2023-02-13 04:03:47,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cc7353a5827a0568b6ae928dd1077028; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60305774, jitterRate=-0.10137394070625305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:47,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cc7353a5827a0568b6ae928dd1077028: Running coprocessor pre-open hook at 1676261027225Writing region info on filesystem at 1676261027225Initializing all the Stores at 1676261027226 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027226Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027226Cleaning up temporary data from old regions at 1676261027239 (+13 ms)Cleaning up detritus from prior splits at 1676261027239Running coprocessor post-open hooks at 1676261027245 (+6 ms)Region opened successfully at 1676261027245 2023-02-13 04:03:47,245 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86cc148bad996fa54a1262ed289ea06f columnFamilyName f2 2023-02-13 04:03:47,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028., pid=26, masterSystemTime=1676261027142 2023-02-13 04:03:47,246 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] regionserver.HStore(310): Store=86cc148bad996fa54a1262ed289ea06f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:47,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:47,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:47,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:47,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:47,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 62f7f3bc3f20c01c645d954e3b69abb7, NAME => 'testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 04:03:47,248 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cc7353a5827a0568b6ae928dd1077028, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:47,248 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261027248"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261027248"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261027248"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261027248"}]},"ts":"1676261027248"} 2023-02-13 04:03:47,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:47,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:47,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:47,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:47,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:47,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=11 2023-02-13 04:03:47,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=11, state=SUCCESS; OpenRegionProcedure cc7353a5827a0568b6ae928dd1077028, server=jenkins-hbase4.apache.org,36883,1676261024911 in 263 msec 2023-02-13 04:03:47,254 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cc7353a5827a0568b6ae928dd1077028, ASSIGN in 437 msec 2023-02-13 04:03:47,255 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:47,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:47,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 86cc148bad996fa54a1262ed289ea06f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64497442, jitterRate=-0.038913220167160034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:47,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 86cc148bad996fa54a1262ed289ea06f: Running coprocessor pre-open hook at 1676261027234Writing region info on filesystem at 1676261027234Initializing all the Stores at 1676261027235 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027235Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027235Cleaning up temporary data from old regions at 1676261027249 (+14 ms)Cleaning up detritus from prior splits at 1676261027249Running coprocessor post-open hooks at 1676261027256 (+7 ms)Region opened successfully at 1676261027256 2023-02-13 04:03:47,257 DEBUG [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f1 2023-02-13 04:03:47,257 DEBUG [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f1 2023-02-13 04:03:47,257 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62f7f3bc3f20c01c645d954e3b69abb7 columnFamilyName f1 2023-02-13 04:03:47,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f., pid=22, masterSystemTime=1676261027148 2023-02-13 04:03:47,258 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] regionserver.HStore(310): Store=62f7f3bc3f20c01c645d954e3b69abb7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,258 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:47,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:47,259 DEBUG [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f2 2023-02-13 04:03:47,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:47,259 DEBUG [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f2 2023-02-13 04:03:47,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:47,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 144c9cc6bb8fb7be885f286b99927ebe, NAME => 'testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 04:03:47,260 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62f7f3bc3f20c01c645d954e3b69abb7 columnFamilyName f2 2023-02-13 04:03:47,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:47,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:47,260 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=86cc148bad996fa54a1262ed289ea06f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:47,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:47,260 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261027260"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261027260"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261027260"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261027260"}]},"ts":"1676261027260"} 2023-02-13 04:03:47,260 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] regionserver.HStore(310): Store=62f7f3bc3f20c01c645d954e3b69abb7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:47,261 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:47,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:47,263 DEBUG [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe/f1 2023-02-13 04:03:47,263 DEBUG [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe/f1 2023-02-13 04:03:47,263 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 144c9cc6bb8fb7be885f286b99927ebe columnFamilyName f1 2023-02-13 04:03:47,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-13 04:03:47,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:47,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure 86cc148bad996fa54a1262ed289ea06f, server=jenkins-hbase4.apache.org,40669,1676261024805 in 286 msec 2023-02-13 04:03:47,264 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] regionserver.HStore(310): Store=144c9cc6bb8fb7be885f286b99927ebe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,265 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:47,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:47,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=86cc148bad996fa54a1262ed289ea06f, ASSIGN in 449 msec 2023-02-13 04:03:47,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:47,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 62f7f3bc3f20c01c645d954e3b69abb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68663644, jitterRate=0.02316802740097046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:47,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 62f7f3bc3f20c01c645d954e3b69abb7: Running coprocessor pre-open hook at 1676261027249Writing region info on filesystem at 1676261027249Initializing all the Stores at 1676261027250 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027250Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027255 (+5 ms)Cleaning up temporary data from old regions at 1676261027263 (+8 ms)Cleaning up detritus from prior splits at 1676261027263Running coprocessor post-open hooks at 1676261027269 (+6 ms)Region opened successfully at 1676261027269 2023-02-13 04:03:47,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7., pid=30, masterSystemTime=1676261027142 2023-02-13 04:03:47,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:47,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:47,271 DEBUG [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe/f2 2023-02-13 04:03:47,272 DEBUG [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe/f2 2023-02-13 04:03:47,272 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=62f7f3bc3f20c01c645d954e3b69abb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,272 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 144c9cc6bb8fb7be885f286b99927ebe columnFamilyName f2 2023-02-13 04:03:47,272 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676261027272"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261027272"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261027272"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261027272"}]},"ts":"1676261027272"} 2023-02-13 04:03:47,272 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] regionserver.HStore(310): Store=144c9cc6bb8fb7be885f286b99927ebe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:47,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:47,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:47,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=14 2023-02-13 04:03:47,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=14, state=SUCCESS; OpenRegionProcedure 62f7f3bc3f20c01c645d954e3b69abb7, server=jenkins-hbase4.apache.org,36883,1676261024911 in 276 msec 2023-02-13 04:03:47,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:47,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=62f7f3bc3f20c01c645d954e3b69abb7, ASSIGN in 461 msec 2023-02-13 04:03:47,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:47,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:47,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 144c9cc6bb8fb7be885f286b99927ebe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72272824, jitterRate=0.07694900035858154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:47,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 144c9cc6bb8fb7be885f286b99927ebe: Running coprocessor pre-open hook at 1676261027260Writing region info on filesystem at 1676261027260Initializing all the Stores at 1676261027261 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027261Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261027261Cleaning up temporary data from old regions at 1676261027275 (+14 ms)Cleaning up detritus from prior splits at 1676261027275Running coprocessor post-open hooks at 1676261027280 (+5 ms)Region opened successfully at 1676261027280 2023-02-13 04:03:47,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe., pid=23, masterSystemTime=1676261027148 2023-02-13 04:03:47,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:47,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:47,282 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=144c9cc6bb8fb7be885f286b99927ebe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,283 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676261027282"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261027282"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261027282"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261027282"}]},"ts":"1676261027282"} 2023-02-13 04:03:47,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-13 04:03:47,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure 144c9cc6bb8fb7be885f286b99927ebe, server=jenkins-hbase4.apache.org,40669,1676261024805 in 307 msec 2023-02-13 04:03:47,289 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-13 04:03:47,289 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=144c9cc6bb8fb7be885f286b99927ebe, ASSIGN in 471 msec 2023-02-13 04:03:47,289 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:03:47,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261027289"}]},"ts":"1676261027289"} 2023-02-13 04:03:47,291 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 04:03:47,293 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:03:47,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 995 msec 2023-02-13 04:03:47,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:47,410 INFO [Listener at localhost/36687] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 04:03:47,411 DEBUG [Listener at localhost/36687] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 04:03:47,411 INFO [Listener at localhost/36687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:03:47,416 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 04:03:47,417 INFO [Listener at localhost/36687] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:03:47,417 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 04:03:47,417 INFO [Listener at localhost/36687] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 04:03:47,432 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 04:03:47,540 DEBUG [hconnection-0x1bf6ee94-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:47,558 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40669] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:47,568 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58574, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:47,594 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36883] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:47,696 INFO [Listener at localhost/36687] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 04:03:47,697 INFO [Listener at localhost/36687] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 04:03:47,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 04:03:47,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676261027698 (current time:1676261027698). 2023-02-13 04:03:47,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 04:03:47,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] zookeeper.ReadOnlyZKClient(139): Connect 0x77a4a64d to 127.0.0.1:56899 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:47,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@494d19ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:47,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:47,709 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44546, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:47,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77a4a64d to 127.0.0.1:56899 2023-02-13 04:03:47,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:47,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 04:03:47,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 04:03:47,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 04:03:47,716 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 04:03:47,716 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676261627716 2023-02-13 04:03:47,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 04:03:47,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 04:03:47,718 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 04:03:47,718 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 04:03:47,718 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 04:03:47,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 04:03:47,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-13 04:03:47,721 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 04:03:47,721 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676261627721 2023-02-13 04:03:47,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,747 INFO [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-13 04:03:47,747 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:47,747 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-13 04:03:47,747 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-13 04:03:47,748 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,748 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,749 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:47,749 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:47,749 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:47,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:47,750 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,750 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,750 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,750 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:03:47,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-13 04:03:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 04:03:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-13 04:03:47,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 04:03:47,751 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-13 04:03:47,751 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:47,752 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,752 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-13 04:03:47,752 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-13 04:03:47,752 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40669,1676261024805' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-13 04:03:47,753 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-13 04:03:47,753 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:47,753 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-13 04:03:47,753 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-13 04:03:47,753 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36883,1676261024911' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-13 04:03:47,755 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,755 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:47,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:47,757 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,757 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:47,757 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,757 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:47,757 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,757 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:47,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:47,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:47,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40669,1676261024805' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-13 04:03:47,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35ae1f44[Count = 1] remaining members to acquire global barrier 2023-02-13 04:03:47,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:47,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:47,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:47,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:47,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:47,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36883,1676261024911' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-13 04:03:47,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35ae1f44[Count = 0] remaining members to acquire global barrier 2023-02-13 04:03:47,761 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-13 04:03:47,761 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,762 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,762 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,762 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-13 04:03:47,762 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:47,762 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-13 04:03:47,762 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:47,762 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. started... 2023-02-13 04:03:47,762 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:47,763 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:03:47,764 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 47629f72f274f163d1ab72258ac4bb3b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:47,764 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:47,764 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 04:03:47,765 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:03:47,764 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:47,765 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:47,765 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. started... 2023-02-13 04:03:47,765 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. started... 2023-02-13 04:03:47,765 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:47,764 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. started... 2023-02-13 04:03:47,765 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. started... 2023-02-13 04:03:47,772 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 04:03:47,773 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:47,773 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 4f5dd40c4622943c4fb4af1a2a0ba82d 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 04:03:47,773 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. started... 2023-02-13 04:03:47,773 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 86cc148bad996fa54a1262ed289ea06f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:47,773 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a6aa62f8f30de3b31afd96d5c1977ff3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:47,773 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:03:47,773 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 144c9cc6bb8fb7be885f286b99927ebe: 2023-02-13 04:03:47,775 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,775 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:47,775 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:47,775 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:47,774 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c755ff97300fd153ac6e002461facc3e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:47,818 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:47,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:03:47,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:03:47,820 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 04:03:47,828 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. completed. 2023-02-13 04:03:47,828 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:47,829 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:47,829 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 04:03:47,829 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. started... 2023-02-13 04:03:47,835 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 44fcb2a197fd68783177ef7b01cbd259 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 04:03:47,838 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/.tmp/f1/891632f9af744dd381952f58dd3c6ab0 2023-02-13 04:03:47,851 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/.tmp/f1/afdff401f1584314b105c9623c3903b4 2023-02-13 04:03:47,865 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/.tmp/f1/c5f26c98ccff42b996e6c4e5cbb503f9 2023-02-13 04:03:47,867 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/.tmp/f1/4236a46e2bf34c28af09ad5e8ea3c473 2023-02-13 04:03:47,868 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/.tmp/f1/fd3121296bb84a868e6cafbe688e6fda 2023-02-13 04:03:47,922 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/.tmp/f1/db5ebc6e352a4d0db661014efe738ead 2023-02-13 04:03:47,924 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/.tmp/f2/d22f9a0c923141e2b918ece9553a8cc1 2023-02-13 04:03:47,925 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/.tmp/f2/1133ebe5c0d64bdfacb4d2fb67fef034 2023-02-13 04:03:47,931 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/.tmp/f1/891632f9af744dd381952f58dd3c6ab0 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f1/891632f9af744dd381952f58dd3c6ab0 2023-02-13 04:03:47,934 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/.tmp/f1/afdff401f1584314b105c9623c3903b4 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f1/afdff401f1584314b105c9623c3903b4 2023-02-13 04:03:47,938 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f1/891632f9af744dd381952f58dd3c6ab0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:47,939 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/.tmp/f2/d22f9a0c923141e2b918ece9553a8cc1 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f2/d22f9a0c923141e2b918ece9553a8cc1 2023-02-13 04:03:47,942 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f1/afdff401f1584314b105c9623c3903b4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:03:47,943 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/.tmp/f2/1133ebe5c0d64bdfacb4d2fb67fef034 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f2/1133ebe5c0d64bdfacb4d2fb67fef034 2023-02-13 04:03:47,962 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f2/d22f9a0c923141e2b918ece9553a8cc1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:47,963 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 47629f72f274f163d1ab72258ac4bb3b in 199ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:47,963 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 04:03:47,964 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 47629f72f274f163d1ab72258ac4bb3b: 2023-02-13 04:03:47,964 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,964 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:47,964 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f1/891632f9af744dd381952f58dd3c6ab0] hfiles 2023-02-13 04:03:47,964 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f1/891632f9af744dd381952f58dd3c6ab0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,964 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f2/d22f9a0c923141e2b918ece9553a8cc1] hfiles 2023-02-13 04:03:47,964 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f2/d22f9a0c923141e2b918ece9553a8cc1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,968 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f2/1133ebe5c0d64bdfacb4d2fb67fef034, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:03:47,969 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4f5dd40c4622943c4fb4af1a2a0ba82d in 196ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:47,970 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4f5dd40c4622943c4fb4af1a2a0ba82d: 2023-02-13 04:03:47,970 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,970 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:47,970 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f1/afdff401f1584314b105c9623c3903b4] hfiles 2023-02-13 04:03:47,970 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f1/afdff401f1584314b105c9623c3903b4 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,970 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f2/1133ebe5c0d64bdfacb4d2fb67fef034] hfiles 2023-02-13 04:03:47,970 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f2/1133ebe5c0d64bdfacb4d2fb67fef034 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:47,976 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/.tmp/f2/0ab9a694dcfc42b590bcac28ea8b7aab 2023-02-13 04:03:47,982 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/.tmp/f1/fd3121296bb84a868e6cafbe688e6fda as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f1/fd3121296bb84a868e6cafbe688e6fda 2023-02-13 04:03:47,999 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f1/fd3121296bb84a868e6cafbe688e6fda, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:47,999 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/.tmp/f2/91479c5cabd943a08bf2086d4e1eff09 2023-02-13 04:03:48,000 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/.tmp/f2/0ab9a694dcfc42b590bcac28ea8b7aab as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f2/0ab9a694dcfc42b590bcac28ea8b7aab 2023-02-13 04:03:48,005 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/.tmp/f2/153bc34b2c8943618910e8a01fe1f6ae 2023-02-13 04:03:48,012 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/.tmp/f1/c5f26c98ccff42b996e6c4e5cbb503f9 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f1/c5f26c98ccff42b996e6c4e5cbb503f9 2023-02-13 04:03:48,015 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f2/0ab9a694dcfc42b590bcac28ea8b7aab, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:48,016 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a6aa62f8f30de3b31afd96d5c1977ff3 in 244ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:48,016 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a6aa62f8f30de3b31afd96d5c1977ff3: 2023-02-13 04:03:48,016 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,017 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:48,017 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f1/fd3121296bb84a868e6cafbe688e6fda] hfiles 2023-02-13 04:03:48,017 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f1/fd3121296bb84a868e6cafbe688e6fda for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,017 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f2/0ab9a694dcfc42b590bcac28ea8b7aab] hfiles 2023-02-13 04:03:48,017 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f2/0ab9a694dcfc42b590bcac28ea8b7aab for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,020 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/.tmp/f2/bd4b760b97a84458b877375e8fee248b 2023-02-13 04:03:48,020 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:48,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:03:48,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:03:48,022 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 04:03:48,024 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/.tmp/f1/4236a46e2bf34c28af09ad5e8ea3c473 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f1/4236a46e2bf34c28af09ad5e8ea3c473 2023-02-13 04:03:48,029 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f1/c5f26c98ccff42b996e6c4e5cbb503f9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:48,030 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/.tmp/f2/91479c5cabd943a08bf2086d4e1eff09 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f2/91479c5cabd943a08bf2086d4e1eff09 2023-02-13 04:03:48,039 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/.tmp/f1/db5ebc6e352a4d0db661014efe738ead as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f1/db5ebc6e352a4d0db661014efe738ead 2023-02-13 04:03:48,045 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. completed. 2023-02-13 04:03:48,045 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:48,045 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:48,045 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 04:03:48,045 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. started... 2023-02-13 04:03:48,045 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cc7353a5827a0568b6ae928dd1077028: 2023-02-13 04:03:48,046 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,046 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:48,046 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:48,046 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:48,046 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f1/db5ebc6e352a4d0db661014efe738ead, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:03:48,047 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/.tmp/f2/bd4b760b97a84458b877375e8fee248b as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f2/bd4b760b97a84458b877375e8fee248b 2023-02-13 04:03:48,053 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f2/bd4b760b97a84458b877375e8fee248b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:03:48,054 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 44fcb2a197fd68783177ef7b01cbd259 in 219ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:48,055 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 44fcb2a197fd68783177ef7b01cbd259: 2023-02-13 04:03:48,055 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,055 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:48,055 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f1/db5ebc6e352a4d0db661014efe738ead] hfiles 2023-02-13 04:03:48,055 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f1/db5ebc6e352a4d0db661014efe738ead for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,055 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f2/bd4b760b97a84458b877375e8fee248b] hfiles 2023-02-13 04:03:48,055 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f2/bd4b760b97a84458b877375e8fee248b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,059 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f2/91479c5cabd943a08bf2086d4e1eff09, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:48,060 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 86cc148bad996fa54a1262ed289ea06f in 288ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:48,060 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 86cc148bad996fa54a1262ed289ea06f: 2023-02-13 04:03:48,060 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,060 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:48,060 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f1/c5f26c98ccff42b996e6c4e5cbb503f9] hfiles 2023-02-13 04:03:48,060 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f1/c5f26c98ccff42b996e6c4e5cbb503f9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,060 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f2/91479c5cabd943a08bf2086d4e1eff09] hfiles 2023-02-13 04:03:48,060 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f2/91479c5cabd943a08bf2086d4e1eff09 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,077 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f1/4236a46e2bf34c28af09ad5e8ea3c473, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:48,078 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/.tmp/f2/153bc34b2c8943618910e8a01fe1f6ae as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f2/153bc34b2c8943618910e8a01fe1f6ae 2023-02-13 04:03:48,100 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. completed. 2023-02-13 04:03:48,100 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:48,100 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:48,100 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 04:03:48,100 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. started... 2023-02-13 04:03:48,101 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 62f7f3bc3f20c01c645d954e3b69abb7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:48,104 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f2/153bc34b2c8943618910e8a01fe1f6ae, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:48,105 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c755ff97300fd153ac6e002461facc3e in 331ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:48,105 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c755ff97300fd153ac6e002461facc3e: 2023-02-13 04:03:48,105 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,105 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:48,106 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f1/4236a46e2bf34c28af09ad5e8ea3c473] hfiles 2023-02-13 04:03:48,106 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f1/4236a46e2bf34c28af09ad5e8ea3c473 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,106 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f2/153bc34b2c8943618910e8a01fe1f6ae] hfiles 2023-02-13 04:03:48,106 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f2/153bc34b2c8943618910e8a01fe1f6ae for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,112 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. completed. 2023-02-13 04:03:48,112 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:48,112 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. completed. 2023-02-13 04:03:48,112 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:48,112 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 04:03:48,112 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 04:03:48,112 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:48,113 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. started... 2023-02-13 04:03:48,113 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3e263c48eebc5aa48ed5c2a4a4863a12 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:48,120 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. completed. 2023-02-13 04:03:48,120 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:48,120 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 04:03:48,139 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. completed. 2023-02-13 04:03:48,139 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:48,140 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 04:03:48,152 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/.tmp/f1/35d0f519d53a41d8ae8951803b942db6 2023-02-13 04:03:48,153 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. completed. 2023-02-13 04:03:48,153 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:48,153 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 04:03:48,160 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/.tmp/f1/909e0a97c1894875a45c26cbe336a1d8 2023-02-13 04:03:48,192 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/.tmp/f2/697d362b514e4ed89a1a18d7670f4fc0 2023-02-13 04:03:48,199 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/.tmp/f1/35d0f519d53a41d8ae8951803b942db6 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f1/35d0f519d53a41d8ae8951803b942db6 2023-02-13 04:03:48,204 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/.tmp/f2/e86c2014ab424de68b49fb2ff51203ee 2023-02-13 04:03:48,207 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f1/35d0f519d53a41d8ae8951803b942db6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:48,209 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/.tmp/f2/697d362b514e4ed89a1a18d7670f4fc0 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f2/697d362b514e4ed89a1a18d7670f4fc0 2023-02-13 04:03:48,211 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/.tmp/f1/909e0a97c1894875a45c26cbe336a1d8 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f1/909e0a97c1894875a45c26cbe336a1d8 2023-02-13 04:03:48,217 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f2/697d362b514e4ed89a1a18d7670f4fc0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:48,217 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f1/909e0a97c1894875a45c26cbe336a1d8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:48,218 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/.tmp/f2/e86c2014ab424de68b49fb2ff51203ee as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f2/e86c2014ab424de68b49fb2ff51203ee 2023-02-13 04:03:48,218 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 62f7f3bc3f20c01c645d954e3b69abb7 in 117ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:48,219 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 62f7f3bc3f20c01c645d954e3b69abb7: 2023-02-13 04:03:48,219 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,219 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:48,219 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f1/35d0f519d53a41d8ae8951803b942db6] hfiles 2023-02-13 04:03:48,219 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f1/35d0f519d53a41d8ae8951803b942db6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,219 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f2/697d362b514e4ed89a1a18d7670f4fc0] hfiles 2023-02-13 04:03:48,219 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f2/697d362b514e4ed89a1a18d7670f4fc0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,225 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f2/e86c2014ab424de68b49fb2ff51203ee, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:48,226 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3e263c48eebc5aa48ed5c2a4a4863a12 in 113ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:48,226 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3e263c48eebc5aa48ed5c2a4a4863a12: 2023-02-13 04:03:48,226 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,226 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:48,226 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f1/909e0a97c1894875a45c26cbe336a1d8] hfiles 2023-02-13 04:03:48,226 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f1/909e0a97c1894875a45c26cbe336a1d8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,226 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f2/e86c2014ab424de68b49fb2ff51203ee] hfiles 2023-02-13 04:03:48,226 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f2/e86c2014ab424de68b49fb2ff51203ee for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,251 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. completed. 2023-02-13 04:03:48,251 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:48,251 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 04:03:48,251 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 04:03:48,251 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,251 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-13 04:03:48,251 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,36883,1676261024911' in zk 2023-02-13 04:03:48,256 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-13 04:03:48,256 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,256 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:48,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:48,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:48,256 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-13 04:03:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:48,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,36883,1676261024911': 2023-02-13 04:03:48,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36883,1676261024911' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 04:03:48,322 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:48,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:03:48,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:03:48,325 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 04:03:48,656 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. completed. 2023-02-13 04:03:48,656 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:48,656 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 04:03:48,656 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 04:03:48,656 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,656 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-13 04:03:48,656 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,40669,1676261024805' in zk 2023-02-13 04:03:48,658 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,658 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-13 04:03:48,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:48,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:48,658 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:48,659 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-13 04:03:48,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:48,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:48,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:48,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,40669,1676261024805': 2023-02-13 04:03:48,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40669,1676261024805' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 04:03:48,663 INFO [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-13 04:03:48,663 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:03:48,663 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:03:48,663 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,663 INFO [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 04:03:48,665 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,665 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:48,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:48,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,665 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:48,665 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,666 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:48,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:48,666 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:48,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:48,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:48,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:48,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,667 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:48,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,668 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:48,669 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,675 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,675 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:48,675 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:48,675 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:48,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:48,676 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:48,675 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,676 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:48,676 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,676 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:48,676 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:48,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:48,677 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:48,677 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,677 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:48,677 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,677 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:48,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:48,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-13 04:03:48,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,752 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:48,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676261027717Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676261028677 (+960 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676261028677Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676261028690 (+13 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676261028703 (+13 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676261028752 (+49 ms) 2023-02-13 04:03:48,754 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 04:03:48,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0360 sec 2023-02-13 04:03:48,825 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:48,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:03:48,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 04:03:48,827 INFO [Listener at localhost/36687] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 04:03:48,832 INFO [Listener at localhost/36687] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 04:03:48,841 INFO [Listener at localhost/36687] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 04:03:48,893 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40669] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:48,894 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36883] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:48,987 INFO [Listener at localhost/36687] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 04:03:48,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:03:48,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 04:03:48,998 INFO [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 04:03:48,998 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:03:48,999 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 04:03:48,999 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 04:03:49,000 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,000 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:49,001 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:49,001 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:49,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:49,001 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:49,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:49,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:49,002 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,002 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:49,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:49,003 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,003 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:03:49,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:03:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:03:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:49,004 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 04:03:49,004 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 04:03:49,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 04:03:49,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 04:03:49,008 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 04:03:49,008 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:03:49,009 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 04:03:49,009 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 04:03:49,009 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:03:49,012 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 04:03:49,012 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:49,013 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. started... 2023-02-13 04:03:49,013 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:49,013 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. started... 2023-02-13 04:03:49,013 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 86cc148bad996fa54a1262ed289ea06f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:49,013 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 144c9cc6bb8fb7be885f286b99927ebe: 2023-02-13 04:03:49,013 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:49,013 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 04:03:49,014 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:49,014 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. started... 2023-02-13 04:03:49,014 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:49,014 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 44fcb2a197fd68783177ef7b01cbd259 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 04:03:49,014 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:03:49,014 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. started... 2023-02-13 04:03:49,014 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:49,014 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 04:03:49,014 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 47629f72f274f163d1ab72258ac4bb3b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:49,014 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. started... 2023-02-13 04:03:49,014 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c755ff97300fd153ac6e002461facc3e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:49,015 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:49,015 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. started... 2023-02-13 04:03:49,015 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a6aa62f8f30de3b31afd96d5c1977ff3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:49,015 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 04:03:49,015 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:03:49,016 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:49,016 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. started... 2023-02-13 04:03:49,016 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4f5dd40c4622943c4fb4af1a2a0ba82d 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 04:03:49,060 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/.tmp/f1/e98e7d452884493d8d07febe8e20addc 2023-02-13 04:03:49,061 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/.tmp/f1/63ddd69a62e14ba69bfa0f7bf4e86636 2023-02-13 04:03:49,076 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/.tmp/f1/0ce7851893c943df957eed2e7a662edc 2023-02-13 04:03:49,084 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/.tmp/f1/f90dba8c3b3047f681f1f6bb8a165a3e 2023-02-13 04:03:49,097 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/.tmp/f1/553a8026ca4d4e2d96b70872091c9aea 2023-02-13 04:03:49,105 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/.tmp/f1/ed0afb41634e4a30833d537a2a282032 2023-02-13 04:03:49,109 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/.tmp/f2/454c0f9904f24457a5a2d0ab1b95ee1c 2023-02-13 04:03:49,116 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/.tmp/f1/63ddd69a62e14ba69bfa0f7bf4e86636 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f1/63ddd69a62e14ba69bfa0f7bf4e86636 2023-02-13 04:03:49,127 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/.tmp/f2/c82c0dc36724465883d98988e9d82ef0 2023-02-13 04:03:49,130 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/.tmp/f2/24478665f9354190af2dbc94678dbbed 2023-02-13 04:03:49,131 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f1/63ddd69a62e14ba69bfa0f7bf4e86636, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:03:49,133 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/.tmp/f2/454c0f9904f24457a5a2d0ab1b95ee1c as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f2/454c0f9904f24457a5a2d0ab1b95ee1c 2023-02-13 04:03:49,139 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/.tmp/f1/f90dba8c3b3047f681f1f6bb8a165a3e as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f1/f90dba8c3b3047f681f1f6bb8a165a3e 2023-02-13 04:03:49,141 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/.tmp/f1/e98e7d452884493d8d07febe8e20addc as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f1/e98e7d452884493d8d07febe8e20addc 2023-02-13 04:03:49,143 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/.tmp/f2/8f881f95973c4278a9af7a2c62d6962e 2023-02-13 04:03:49,144 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f2/454c0f9904f24457a5a2d0ab1b95ee1c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:03:49,145 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 44fcb2a197fd68783177ef7b01cbd259 in 131ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:49,145 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 44fcb2a197fd68783177ef7b01cbd259: 2023-02-13 04:03:49,146 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:49,151 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:49,151 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. started... 2023-02-13 04:03:49,151 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 04:03:49,151 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3e263c48eebc5aa48ed5c2a4a4863a12 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:49,152 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/.tmp/f1/0ce7851893c943df957eed2e7a662edc as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f1/0ce7851893c943df957eed2e7a662edc 2023-02-13 04:03:49,153 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f1/e98e7d452884493d8d07febe8e20addc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,154 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f1/f90dba8c3b3047f681f1f6bb8a165a3e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,154 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/.tmp/f2/24478665f9354190af2dbc94678dbbed as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f2/24478665f9354190af2dbc94678dbbed 2023-02-13 04:03:49,155 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/.tmp/f2/c82c0dc36724465883d98988e9d82ef0 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f2/c82c0dc36724465883d98988e9d82ef0 2023-02-13 04:03:49,163 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f1/0ce7851893c943df957eed2e7a662edc, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:03:49,164 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/.tmp/f2/8f881f95973c4278a9af7a2c62d6962e as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f2/8f881f95973c4278a9af7a2c62d6962e 2023-02-13 04:03:49,167 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f2/24478665f9354190af2dbc94678dbbed, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,168 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 86cc148bad996fa54a1262ed289ea06f in 155ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:49,169 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 86cc148bad996fa54a1262ed289ea06f: 2023-02-13 04:03:49,169 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f2/c82c0dc36724465883d98988e9d82ef0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,169 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:49,169 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 04:03:49,169 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c755ff97300fd153ac6e002461facc3e in 155ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:49,170 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c755ff97300fd153ac6e002461facc3e: 2023-02-13 04:03:49,170 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:49,170 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 04:03:49,182 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f2/8f881f95973c4278a9af7a2c62d6962e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:03:49,184 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4f5dd40c4622943c4fb4af1a2a0ba82d in 168ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:49,184 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4f5dd40c4622943c4fb4af1a2a0ba82d: 2023-02-13 04:03:49,184 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:49,185 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:49,185 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. started... 2023-02-13 04:03:49,185 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 04:03:49,185 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cc7353a5827a0568b6ae928dd1077028: 2023-02-13 04:03:49,185 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:49,185 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:49,185 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. started... 2023-02-13 04:03:49,185 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 04:03:49,185 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 62f7f3bc3f20c01c645d954e3b69abb7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:03:49,188 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/.tmp/f2/6c877ba236fc4887b266a543acd3c53d 2023-02-13 04:03:49,194 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/.tmp/f1/553a8026ca4d4e2d96b70872091c9aea as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f1/553a8026ca4d4e2d96b70872091c9aea 2023-02-13 04:03:49,200 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f1/553a8026ca4d4e2d96b70872091c9aea, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,201 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/.tmp/f2/6c877ba236fc4887b266a543acd3c53d as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f2/6c877ba236fc4887b266a543acd3c53d 2023-02-13 04:03:49,216 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/.tmp/f2/22e2279b465a4e29844caf312d44b425 2023-02-13 04:03:49,219 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/.tmp/f1/8826e8525f1c439ebf50efd13d53a737 2023-02-13 04:03:49,221 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f2/6c877ba236fc4887b266a543acd3c53d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,222 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a6aa62f8f30de3b31afd96d5c1977ff3 in 207ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:49,222 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a6aa62f8f30de3b31afd96d5c1977ff3: 2023-02-13 04:03:49,222 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:49,222 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 04:03:49,223 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/.tmp/f1/0e934b1d71024a94874429219d4bfc23 2023-02-13 04:03:49,227 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/.tmp/f1/ed0afb41634e4a30833d537a2a282032 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f1/ed0afb41634e4a30833d537a2a282032 2023-02-13 04:03:49,236 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f1/ed0afb41634e4a30833d537a2a282032, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,237 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/.tmp/f2/22e2279b465a4e29844caf312d44b425 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f2/22e2279b465a4e29844caf312d44b425 2023-02-13 04:03:49,246 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f2/22e2279b465a4e29844caf312d44b425, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,247 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 47629f72f274f163d1ab72258ac4bb3b in 233ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:49,247 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 47629f72f274f163d1ab72258ac4bb3b: 2023-02-13 04:03:49,247 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:49,247 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 04:03:49,248 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/.tmp/f2/f200a23a1f164c9ab0a0c2a730338bba 2023-02-13 04:03:49,258 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/.tmp/f1/8826e8525f1c439ebf50efd13d53a737 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f1/8826e8525f1c439ebf50efd13d53a737 2023-02-13 04:03:49,259 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/.tmp/f2/369e47476c4c4b8eba0551963c6035f1 2023-02-13 04:03:49,264 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f1/8826e8525f1c439ebf50efd13d53a737, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,265 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/.tmp/f2/f200a23a1f164c9ab0a0c2a730338bba as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f2/f200a23a1f164c9ab0a0c2a730338bba 2023-02-13 04:03:49,265 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/.tmp/f1/0e934b1d71024a94874429219d4bfc23 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f1/0e934b1d71024a94874429219d4bfc23 2023-02-13 04:03:49,270 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f2/f200a23a1f164c9ab0a0c2a730338bba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,271 INFO [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3e263c48eebc5aa48ed5c2a4a4863a12 in 120ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:49,271 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3e263c48eebc5aa48ed5c2a4a4863a12: 2023-02-13 04:03:49,271 DEBUG [rs(jenkins-hbase4.apache.org,40669,1676261024805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 04:03:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 04:03:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,271 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 04:03:49,272 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40669,1676261024805' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 04:03:49,274 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f1/0e934b1d71024a94874429219d4bfc23, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,274 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,274 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:49,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:49,274 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,275 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:49,275 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/.tmp/f2/369e47476c4c4b8eba0551963c6035f1 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f2/369e47476c4c4b8eba0551963c6035f1 2023-02-13 04:03:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:49,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:49,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:49,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40669,1676261024805' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 04:03:49,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31918d29[Count = 1] remaining members to acquire global barrier 2023-02-13 04:03:49,279 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f2/369e47476c4c4b8eba0551963c6035f1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:03:49,280 INFO [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 62f7f3bc3f20c01c645d954e3b69abb7 in 95ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:49,280 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 62f7f3bc3f20c01c645d954e3b69abb7: 2023-02-13 04:03:49,280 DEBUG [rs(jenkins-hbase4.apache.org,36883,1676261024911)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 04:03:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 04:03:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,280 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 04:03:49,281 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36883,1676261024911' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 04:03:49,282 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,282 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:49,282 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,282 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:49,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:49,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:49,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36883,1676261024911' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 04:03:49,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31918d29[Count = 0] remaining members to acquire global barrier 2023-02-13 04:03:49,284 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 04:03:49,285 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,286 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,286 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,286 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,286 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 04:03:49,286 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 04:03:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,286 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36883,1676261024911' in zk 2023-02-13 04:03:49,286 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 04:03:49,286 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 04:03:49,286 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40669,1676261024805' in zk 2023-02-13 04:03:49,286 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,287 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:03:49,288 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 04:03:49,288 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,288 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:49,288 DEBUG [member: 'jenkins-hbase4.apache.org,36883,1676261024911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 04:03:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:49,290 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,290 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 04:03:49,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:49,290 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:49,290 DEBUG [member: 'jenkins-hbase4.apache.org,40669,1676261024805' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 04:03:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:49,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,36883,1676261024911': 2023-02-13 04:03:49,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36883,1676261024911' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-13 04:03:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40669,1676261024805': 2023-02-13 04:03:49,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40669,1676261024805' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 04:03:49,296 INFO [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 04:03:49,296 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:03:49,296 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:03:49,296 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 04:03:49,296 INFO [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:03:49,298 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,299 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:49,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:49,299 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:49,299 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,299 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:49,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:49,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,299 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:49,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:49,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:49,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:49,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:49,300 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:49,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,302 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:49,303 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:03:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,306 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:49,306 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:49,306 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:49,306 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:49,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:49,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:49,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:49,306 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:49,306 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,307 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:03:49,307 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,307 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,307 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,307 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:03:49,307 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:03:49,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:49,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:49,306 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:49,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-13 04:03:49,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 04:03:49,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:03:49,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:49,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:49,306 DEBUG [(jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:49,308 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 04:03:49,308 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:03:49,408 DEBUG [Listener at localhost/36687] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:03:49,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34675] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:03:49,410 INFO [Listener at localhost/36687] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:03:49,411 DEBUG [Listener at localhost/36687] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e13a120 to 127.0.0.1:56899 2023-02-13 04:03:49,411 DEBUG [Listener at localhost/36687] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:49,411 DEBUG [Listener at localhost/36687] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 04:03:49,411 DEBUG [Listener at localhost/36687] util.JVMClusterUtil(257): Found active master hash=1812834395, stopped=false 2023-02-13 04:03:49,411 INFO [Listener at localhost/36687] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34675,1676261024674 2023-02-13 04:03:49,414 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:49,414 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:49,414 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:49,414 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:49,414 INFO [Listener at localhost/36687] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 04:03:49,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:49,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:49,416 DEBUG [Listener at localhost/36687] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b93e8aa to 127.0.0.1:56899 2023-02-13 04:03:49,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:49,417 DEBUG [Listener at localhost/36687] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:49,417 INFO [Listener at localhost/36687] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40669,1676261024805' ***** 2023-02-13 04:03:49,417 INFO [Listener at localhost/36687] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:03:49,417 INFO [Listener at localhost/36687] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36883,1676261024911' ***** 2023-02-13 04:03:49,417 INFO [Listener at localhost/36687] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:03:49,417 INFO [RS:0;jenkins-hbase4:40669] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:03:49,417 INFO [RS:0;jenkins-hbase4:40669] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:03:49,417 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:03:49,417 INFO [RS:0;jenkins-hbase4:40669] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:03:49,418 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(3304): Received CLOSE for 86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:49,418 INFO [RS:1;jenkins-hbase4:36883] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:03:49,418 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(3304): Received CLOSE for 144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:49,418 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:03:49,418 INFO [RS:1;jenkins-hbase4:36883] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:03:49,419 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(3304): Received CLOSE for c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:49,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 86cc148bad996fa54a1262ed289ea06f, disabling compactions & flushes 2023-02-13 04:03:49,419 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(3304): Received CLOSE for 44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:49,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:49,419 INFO [RS:1;jenkins-hbase4:36883] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:03:49,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:49,420 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(3304): Received CLOSE for 47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:49,419 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(3304): Received CLOSE for 3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:49,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. after waiting 0 ms 2023-02-13 04:03:49,420 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(3304): Received CLOSE for a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:49,420 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,420 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(3304): Received CLOSE for 4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:49,420 DEBUG [RS:0;jenkins-hbase4:40669] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39d379e0 to 127.0.0.1:56899 2023-02-13 04:03:49,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 47629f72f274f163d1ab72258ac4bb3b, disabling compactions & flushes 2023-02-13 04:03:49,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:49,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:49,420 DEBUG [RS:0;jenkins-hbase4:40669] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:49,420 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(3304): Received CLOSE for cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:49,420 INFO [RS:0;jenkins-hbase4:40669] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:03:49,420 INFO [RS:0;jenkins-hbase4:40669] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:03:49,420 INFO [RS:0;jenkins-hbase4:40669] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:03:49,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:49,420 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 04:03:49,420 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(3304): Received CLOSE for 62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:49,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. after waiting 0 ms 2023-02-13 04:03:49,422 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-13 04:03:49,421 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(3304): Received CLOSE for 5f4061676a4cdcf751c16fc072a83c5d 2023-02-13 04:03:49,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:03:49,423 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,423 DEBUG [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1479): Online Regions={86cc148bad996fa54a1262ed289ea06f=testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f., 144c9cc6bb8fb7be885f286b99927ebe=testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe., c755ff97300fd153ac6e002461facc3e=testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e., 1588230740=hbase:meta,,1.1588230740, 44fcb2a197fd68783177ef7b01cbd259=testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259., 3e263c48eebc5aa48ed5c2a4a4863a12=testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.} 2023-02-13 04:03:49,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:49,424 DEBUG [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1505): Waiting on 144c9cc6bb8fb7be885f286b99927ebe, 1588230740, 3e263c48eebc5aa48ed5c2a4a4863a12, 44fcb2a197fd68783177ef7b01cbd259, 86cc148bad996fa54a1262ed289ea06f, c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:49,424 DEBUG [RS:1;jenkins-hbase4:36883] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13ad1457 to 127.0.0.1:56899 2023-02-13 04:03:49,424 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:03:49,427 DEBUG [RS:1;jenkins-hbase4:36883] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:49,427 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:03:49,428 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-13 04:03:49,428 DEBUG [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1479): Online Regions={47629f72f274f163d1ab72258ac4bb3b=testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b., a6aa62f8f30de3b31afd96d5c1977ff3=testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3., 4f5dd40c4622943c4fb4af1a2a0ba82d=testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d., cc7353a5827a0568b6ae928dd1077028=testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028., 62f7f3bc3f20c01c645d954e3b69abb7=testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7., 5f4061676a4cdcf751c16fc072a83c5d=hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d.} 2023-02-13 04:03:49,428 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:03:49,428 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:03:49,428 DEBUG [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1505): Waiting on 47629f72f274f163d1ab72258ac4bb3b, 4f5dd40c4622943c4fb4af1a2a0ba82d, 5f4061676a4cdcf751c16fc072a83c5d, 62f7f3bc3f20c01c645d954e3b69abb7, a6aa62f8f30de3b31afd96d5c1977ff3, cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:49,429 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-13 04:03:49,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:49,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:49,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:49,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 86cc148bad996fa54a1262ed289ea06f: Waiting for close lock at 1676261029419Running coprocessor pre-close hooks at 1676261029419Disabling compacts and flushes for region at 1676261029419Disabling writes for close at 1676261029420 (+1 ms)Writing region close event to WAL at 1676261029427 (+7 ms)Running coprocessor post-close hooks at 1676261029438 (+11 ms)Closed at 1676261029439 (+1 ms) 2023-02-13 04:03:49,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:49,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 144c9cc6bb8fb7be885f286b99927ebe, disabling compactions & flushes 2023-02-13 04:03:49,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:49,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:49,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. after waiting 0 ms 2023-02-13 04:03:49,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:49,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:49,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 47629f72f274f163d1ab72258ac4bb3b: Waiting for close lock at 1676261029420Running coprocessor pre-close hooks at 1676261029420Disabling compacts and flushes for region at 1676261029420Disabling writes for close at 1676261029422 (+2 ms)Writing region close event to WAL at 1676261029435 (+13 ms)Running coprocessor post-close hooks at 1676261029439 (+4 ms)Closed at 1676261029440 (+1 ms) 2023-02-13 04:03:49,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:49,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a6aa62f8f30de3b31afd96d5c1977ff3, disabling compactions & flushes 2023-02-13 04:03:49,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:49,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:49,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. after waiting 0 ms 2023-02-13 04:03:49,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:49,449 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:49,449 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:49,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 04:03:49,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:49,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 144c9cc6bb8fb7be885f286b99927ebe: Waiting for close lock at 1676261029439Running coprocessor pre-close hooks at 1676261029439Disabling compacts and flushes for region at 1676261029439Disabling writes for close at 1676261029439Writing region close event to WAL at 1676261029440 (+1 ms)Running coprocessor post-close hooks at 1676261029451 (+11 ms)Closed at 1676261029451 2023-02-13 04:03:49,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:49,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c755ff97300fd153ac6e002461facc3e, disabling compactions & flushes 2023-02-13 04:03:49,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:49,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:49,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. after waiting 0 ms 2023-02-13 04:03:49,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:49,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/.tmp/info/be4783a973904124870140378f641ffc 2023-02-13 04:03:49,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:49,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:49,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a6aa62f8f30de3b31afd96d5c1977ff3: Waiting for close lock at 1676261029440Running coprocessor pre-close hooks at 1676261029440Disabling compacts and flushes for region at 1676261029440Disabling writes for close at 1676261029440Writing region close event to WAL at 1676261029450 (+10 ms)Running coprocessor post-close hooks at 1676261029464 (+14 ms)Closed at 1676261029464 2023-02-13 04:03:49,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:49,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4f5dd40c4622943c4fb4af1a2a0ba82d, disabling compactions & flushes 2023-02-13 04:03:49,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:49,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:49,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. after waiting 0 ms 2023-02-13 04:03:49,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:49,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:49,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:49,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:49,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c755ff97300fd153ac6e002461facc3e: Waiting for close lock at 1676261029451Running coprocessor pre-close hooks at 1676261029451Disabling compacts and flushes for region at 1676261029451Disabling writes for close at 1676261029451Writing region close event to WAL at 1676261029464 (+13 ms)Running coprocessor post-close hooks at 1676261029469 (+5 ms)Closed at 1676261029469 2023-02-13 04:03:49,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:49,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 44fcb2a197fd68783177ef7b01cbd259, disabling compactions & flushes 2023-02-13 04:03:49,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:49,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:49,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:49,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. after waiting 0 ms 2023-02-13 04:03:49,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:49,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4f5dd40c4622943c4fb4af1a2a0ba82d: Waiting for close lock at 1676261029464Running coprocessor pre-close hooks at 1676261029464Disabling compacts and flushes for region at 1676261029464Disabling writes for close at 1676261029465 (+1 ms)Writing region close event to WAL at 1676261029466 (+1 ms)Running coprocessor post-close hooks at 1676261029470 (+4 ms)Closed at 1676261029470 2023-02-13 04:03:49,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:49,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cc7353a5827a0568b6ae928dd1077028, disabling compactions & flushes 2023-02-13 04:03:49,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:49,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:49,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. after waiting 0 ms 2023-02-13 04:03:49,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:49,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 04:03:49,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:49,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cc7353a5827a0568b6ae928dd1077028: Waiting for close lock at 1676261029470Running coprocessor pre-close hooks at 1676261029470Disabling compacts and flushes for region at 1676261029470Disabling writes for close at 1676261029471 (+1 ms)Writing region close event to WAL at 1676261029471Running coprocessor post-close hooks at 1676261029474 (+3 ms)Closed at 1676261029475 (+1 ms) 2023-02-13 04:03:49,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:49,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 62f7f3bc3f20c01c645d954e3b69abb7, disabling compactions & flushes 2023-02-13 04:03:49,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:49,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:49,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. after waiting 0 ms 2023-02-13 04:03:49,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:49,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:49,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:49,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 44fcb2a197fd68783177ef7b01cbd259: Waiting for close lock at 1676261029470Running coprocessor pre-close hooks at 1676261029470Disabling compacts and flushes for region at 1676261029470Disabling writes for close at 1676261029470Writing region close event to WAL at 1676261029472 (+2 ms)Running coprocessor post-close hooks at 1676261029476 (+4 ms)Closed at 1676261029477 (+1 ms) 2023-02-13 04:03:49,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:49,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3e263c48eebc5aa48ed5c2a4a4863a12, disabling compactions & flushes 2023-02-13 04:03:49,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:49,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:49,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. after waiting 0 ms 2023-02-13 04:03:49,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:49,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/.tmp/table/6e71ba357cd14817b345421a66824c2d 2023-02-13 04:03:49,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:49,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:49,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:49,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 62f7f3bc3f20c01c645d954e3b69abb7: Waiting for close lock at 1676261029475Running coprocessor pre-close hooks at 1676261029475Disabling compacts and flushes for region at 1676261029475Disabling writes for close at 1676261029475Writing region close event to WAL at 1676261029478 (+3 ms)Running coprocessor post-close hooks at 1676261029487 (+9 ms)Closed at 1676261029487 2023-02-13 04:03:49,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:49,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:49,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3e263c48eebc5aa48ed5c2a4a4863a12: Waiting for close lock at 1676261029478Running coprocessor pre-close hooks at 1676261029478Disabling compacts and flushes for region at 1676261029478Disabling writes for close at 1676261029478Writing region close event to WAL at 1676261029479 (+1 ms)Running coprocessor post-close hooks at 1676261029487 (+8 ms)Closed at 1676261029487 2023-02-13 04:03:49,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5f4061676a4cdcf751c16fc072a83c5d, disabling compactions & flushes 2023-02-13 04:03:49,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:49,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:49,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:49,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. after waiting 0 ms 2023-02-13 04:03:49,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:49,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 5f4061676a4cdcf751c16fc072a83c5d 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 04:03:49,491 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/.tmp/info/be4783a973904124870140378f641ffc as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/info/be4783a973904124870140378f641ffc 2023-02-13 04:03:49,495 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d/.tmp/info/7a9ce217050a4b5aa12f57718dafa7a9 2023-02-13 04:03:49,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/info/be4783a973904124870140378f641ffc, entries=110, sequenceid=32, filesize=18.7 K 2023-02-13 04:03:49,497 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/.tmp/table/6e71ba357cd14817b345421a66824c2d as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/table/6e71ba357cd14817b345421a66824c2d 2023-02-13 04:03:49,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d/.tmp/info/7a9ce217050a4b5aa12f57718dafa7a9 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d/info/7a9ce217050a4b5aa12f57718dafa7a9 2023-02-13 04:03:49,502 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/table/6e71ba357cd14817b345421a66824c2d, entries=4, sequenceid=32, filesize=4.8 K 2023-02-13 04:03:49,505 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 77ms, sequenceid=32, compaction requested=false 2023-02-13 04:03:49,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 04:03:49,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d/info/7a9ce217050a4b5aa12f57718dafa7a9, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 04:03:49,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5f4061676a4cdcf751c16fc072a83c5d in 19ms, sequenceid=6, compaction requested=false 2023-02-13 04:03:49,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 04:03:49,510 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-13 04:03:49,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/data/hbase/namespace/5f4061676a4cdcf751c16fc072a83c5d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 04:03:49,510 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 04:03:49,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:49,510 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:03:49,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5f4061676a4cdcf751c16fc072a83c5d: Waiting for close lock at 1676261029487Running coprocessor pre-close hooks at 1676261029487Disabling compacts and flushes for region at 1676261029487Disabling writes for close at 1676261029487Obtaining lock to block concurrent updates at 1676261029487Preparing flush snapshotting stores in 5f4061676a4cdcf751c16fc072a83c5d at 1676261029487Finished memstore snapshotting hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676261029487Flushing stores of hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. at 1676261029488 (+1 ms)Flushing 5f4061676a4cdcf751c16fc072a83c5d/info: creating writer at 1676261029488Flushing 5f4061676a4cdcf751c16fc072a83c5d/info: appending metadata at 1676261029490 (+2 ms)Flushing 5f4061676a4cdcf751c16fc072a83c5d/info: closing flushed file at 1676261029490Flushing 5f4061676a4cdcf751c16fc072a83c5d/info: reopening flushed file at 1676261029500 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5f4061676a4cdcf751c16fc072a83c5d in 19ms, sequenceid=6, compaction requested=false at 1676261029506 (+6 ms)Writing region close event to WAL at 1676261029507 (+1 ms)Running coprocessor post-close hooks at 1676261029510 (+3 ms)Closed at 1676261029510 2023-02-13 04:03:49,510 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261029422Running coprocessor pre-close hooks at 1676261029422Disabling compacts and flushes for region at 1676261029423 (+1 ms)Disabling writes for close at 1676261029428 (+5 ms)Obtaining lock to block concurrent updates at 1676261029429 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676261029429Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676261029431 (+2 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676261029432 (+1 ms)Flushing 1588230740/info: creating writer at 1676261029433 (+1 ms)Flushing 1588230740/info: appending metadata at 1676261029438 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676261029438Flushing 1588230740/table: creating writer at 1676261029469 (+31 ms)Flushing 1588230740/table: appending metadata at 1676261029472 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676261029472Flushing 1588230740/info: reopening flushed file at 1676261029491 (+19 ms)Flushing 1588230740/table: reopening flushed file at 1676261029497 (+6 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 77ms, sequenceid=32, compaction requested=false at 1676261029505 (+8 ms)Writing region close event to WAL at 1676261029507 (+2 ms)Running coprocessor post-close hooks at 1676261029510 (+3 ms)Closed at 1676261029510 2023-02-13 04:03:49,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676261025671.5f4061676a4cdcf751c16fc072a83c5d. 2023-02-13 04:03:49,510 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 04:03:49,625 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40669,1676261024805; all regions closed. 2023-02-13 04:03:49,629 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36883,1676261024911; all regions closed. 2023-02-13 04:03:49,630 DEBUG [RS:0;jenkins-hbase4:40669] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/oldWALs 2023-02-13 04:03:49,631 INFO [RS:0;jenkins-hbase4:40669] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40669%2C1676261024805.meta:.meta(num 1676261025587) 2023-02-13 04:03:49,635 DEBUG [RS:1;jenkins-hbase4:36883] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/oldWALs 2023-02-13 04:03:49,635 INFO [RS:1;jenkins-hbase4:36883] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36883%2C1676261024911:(num 1676261026047) 2023-02-13 04:03:49,635 DEBUG [RS:1;jenkins-hbase4:36883] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:49,635 INFO [RS:1;jenkins-hbase4:36883] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:49,636 INFO [RS:1;jenkins-hbase4:36883] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 04:03:49,636 DEBUG [RS:0;jenkins-hbase4:40669] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/oldWALs 2023-02-13 04:03:49,636 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:03:49,636 INFO [RS:0;jenkins-hbase4:40669] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40669%2C1676261024805:(num 1676261026433) 2023-02-13 04:03:49,636 INFO [RS:1;jenkins-hbase4:36883] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:03:49,636 DEBUG [RS:0;jenkins-hbase4:40669] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:49,636 INFO [RS:1;jenkins-hbase4:36883] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:03:49,636 INFO [RS:1;jenkins-hbase4:36883] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:03:49,636 INFO [RS:0;jenkins-hbase4:40669] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:49,637 INFO [RS:1;jenkins-hbase4:36883] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36883 2023-02-13 04:03:49,639 INFO [RS:0;jenkins-hbase4:40669] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 04:03:49,639 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:03:49,640 INFO [RS:0;jenkins-hbase4:40669] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40669 2023-02-13 04:03:49,642 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,642 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:49,642 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36883,1676261024911 2023-02-13 04:03:49,642 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:49,642 ERROR [Listener at localhost/36687-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e27c3e2 rejected from java.util.concurrent.ThreadPoolExecutor@6a184afe[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:49,642 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:49,642 ERROR [Listener at localhost/36687-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e1771e5 rejected from java.util.concurrent.ThreadPoolExecutor@6a184afe[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:49,643 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40669,1676261024805] 2023-02-13 04:03:49,643 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,643 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40669,1676261024805 2023-02-13 04:03:49,643 ERROR [Listener at localhost/36687-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3698659d rejected from java.util.concurrent.ThreadPoolExecutor@6a184afe[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:49,643 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40669,1676261024805; numProcessing=1 2023-02-13 04:03:49,643 ERROR [Listener at localhost/36687-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31885f4e rejected from java.util.concurrent.ThreadPoolExecutor@35b7dda7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:49,644 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40669,1676261024805 already deleted, retry=false 2023-02-13 04:03:49,644 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40669,1676261024805 expired; onlineServers=1 2023-02-13 04:03:49,644 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36883,1676261024911] 2023-02-13 04:03:49,644 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36883,1676261024911; numProcessing=2 2023-02-13 04:03:49,646 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36883,1676261024911 already deleted, retry=false 2023-02-13 04:03:49,646 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36883,1676261024911 expired; onlineServers=0 2023-02-13 04:03:49,646 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34675,1676261024674' ***** 2023-02-13 04:03:49,646 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 04:03:49,647 DEBUG [M:0;jenkins-hbase4:34675] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d30a260, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:49,647 INFO [M:0;jenkins-hbase4:34675] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34675,1676261024674 2023-02-13 04:03:49,647 INFO [M:0;jenkins-hbase4:34675] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34675,1676261024674; all regions closed. 2023-02-13 04:03:49,648 DEBUG [M:0;jenkins-hbase4:34675] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:49,648 DEBUG [M:0;jenkins-hbase4:34675] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 04:03:49,648 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 04:03:49,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261025208] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261025208,5,FailOnTimeoutGroup] 2023-02-13 04:03:49,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261025208] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261025208,5,FailOnTimeoutGroup] 2023-02-13 04:03:49,648 DEBUG [M:0;jenkins-hbase4:34675] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 04:03:49,649 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:49,649 INFO [M:0;jenkins-hbase4:34675] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 04:03:49,649 INFO [M:0;jenkins-hbase4:34675] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 04:03:49,649 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:49,649 INFO [M:0;jenkins-hbase4:34675] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 04:03:49,649 DEBUG [M:0;jenkins-hbase4:34675] master.HMaster(1502): Stopping service threads 2023-02-13 04:03:49,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:49,649 INFO [M:0;jenkins-hbase4:34675] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 04:03:49,650 ERROR [M:0;jenkins-hbase4:34675] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 04:03:49,650 INFO [M:0;jenkins-hbase4:34675] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 04:03:49,650 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 04:03:49,650 DEBUG [M:0;jenkins-hbase4:34675] zookeeper.ZKUtil(398): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 04:03:49,650 WARN [M:0;jenkins-hbase4:34675] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 04:03:49,650 INFO [M:0;jenkins-hbase4:34675] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 04:03:49,651 INFO [M:0;jenkins-hbase4:34675] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 04:03:49,651 DEBUG [M:0;jenkins-hbase4:34675] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:03:49,651 INFO [M:0;jenkins-hbase4:34675] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:49,651 DEBUG [M:0;jenkins-hbase4:34675] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:49,651 DEBUG [M:0;jenkins-hbase4:34675] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:03:49,651 DEBUG [M:0;jenkins-hbase4:34675] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:49,651 INFO [M:0;jenkins-hbase4:34675] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-13 04:03:49,663 INFO [M:0;jenkins-hbase4:34675] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ad343964a5af4313a891e500c49acee2 2023-02-13 04:03:49,669 DEBUG [M:0;jenkins-hbase4:34675] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ad343964a5af4313a891e500c49acee2 as hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ad343964a5af4313a891e500c49acee2 2023-02-13 04:03:49,674 INFO [M:0;jenkins-hbase4:34675] regionserver.HStore(1080): Added hdfs://localhost:33645/user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ad343964a5af4313a891e500c49acee2, entries=31, sequenceid=218, filesize=9.0 K 2023-02-13 04:03:49,675 INFO [M:0;jenkins-hbase4:34675] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=218, compaction requested=false 2023-02-13 04:03:49,676 INFO [M:0;jenkins-hbase4:34675] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:49,676 DEBUG [M:0;jenkins-hbase4:34675] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261029651Disabling compacts and flushes for region at 1676261029651Disabling writes for close at 1676261029651Obtaining lock to block concurrent updates at 1676261029651Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676261029651Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103362, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676261029651Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676261029652 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676261029652Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676261029655 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676261029655Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676261029670 (+15 ms)Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=218, compaction requested=false at 1676261029675 (+5 ms)Writing region close event to WAL at 1676261029676 (+1 ms)Closed at 1676261029676 2023-02-13 04:03:49,680 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/3e950a95-1336-2ce7-bcaa-2bfbafcbea1b/MasterData/WALs/jenkins-hbase4.apache.org,34675,1676261024674/jenkins-hbase4.apache.org%2C34675%2C1676261024674.1676261025118 not finished, retry = 0 2023-02-13 04:03:49,781 INFO [M:0;jenkins-hbase4:34675] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 04:03:49,781 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:03:49,782 INFO [M:0;jenkins-hbase4:34675] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34675 2023-02-13 04:03:49,784 DEBUG [M:0;jenkins-hbase4:34675] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34675,1676261024674 already deleted, retry=false 2023-02-13 04:03:49,915 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:49,915 INFO [M:0;jenkins-hbase4:34675] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34675,1676261024674; zookeeper connection closed. 2023-02-13 04:03:49,915 ERROR [Listener at localhost/36687-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@154c4dd3 rejected from java.util.concurrent.ThreadPoolExecutor@1173dba2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:49,916 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): master:34675-0x1004bd94d2c0000, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:49,916 ERROR [Listener at localhost/36687-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@123a7094 rejected from java.util.concurrent.ThreadPoolExecutor@1173dba2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 54] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:50,015 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:50,015 INFO [RS:0;jenkins-hbase4:40669] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40669,1676261024805; zookeeper connection closed. 2023-02-13 04:03:50,015 ERROR [Listener at localhost/36687-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@328eacba rejected from java.util.concurrent.ThreadPoolExecutor@35b7dda7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:50,016 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@15415118] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@15415118 2023-02-13 04:03:50,016 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:40669-0x1004bd94d2c0001, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:50,016 ERROR [Listener at localhost/36687-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a5e40f9 rejected from java.util.concurrent.ThreadPoolExecutor@35b7dda7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:50,115 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:50,115 INFO [RS:1;jenkins-hbase4:36883] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36883,1676261024911; zookeeper connection closed. 2023-02-13 04:03:50,116 ERROR [Listener at localhost/36687-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ad8eecc rejected from java.util.concurrent.ThreadPoolExecutor@6a184afe[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:50,116 DEBUG [Listener at localhost/36687-EventThread] zookeeper.ZKWatcher(600): regionserver:36883-0x1004bd94d2c0002, quorum=127.0.0.1:56899, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:50,116 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@763086de] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@763086de 2023-02-13 04:03:50,116 ERROR [Listener at localhost/36687-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2d9c8fb9 rejected from java.util.concurrent.ThreadPoolExecutor@6a184afe[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:50,116 INFO [Listener at localhost/36687] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 04:03:50,202 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/hadoop-8526975469993810165.jar 2023-02-13 04:03:50,207 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676261027698 type: FLUSH version: 2 ttl: 0 2023-02-13 04:03:50,207 DEBUG [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(239): region to add: 47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(239): region to add: a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(239): region to add: 4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(239): region to add: cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(239): region to add: 144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(239): region to add: 86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(239): region to add: c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(239): region to add: 62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(239): region to add: 44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(239): region to add: 3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(585): clone region=47629f72f274f163d1ab72258ac4bb3b as 47629f72f274f163d1ab72258ac4bb3b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(585): clone region=a6aa62f8f30de3b31afd96d5c1977ff3 as a6aa62f8f30de3b31afd96d5c1977ff3 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(585): clone region=4f5dd40c4622943c4fb4af1a2a0ba82d as 4f5dd40c4622943c4fb4af1a2a0ba82d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(585): clone region=cc7353a5827a0568b6ae928dd1077028 as cc7353a5827a0568b6ae928dd1077028 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(585): clone region=144c9cc6bb8fb7be885f286b99927ebe as 144c9cc6bb8fb7be885f286b99927ebe in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(585): clone region=86cc148bad996fa54a1262ed289ea06f as 86cc148bad996fa54a1262ed289ea06f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:50,208 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(585): clone region=c755ff97300fd153ac6e002461facc3e as c755ff97300fd153ac6e002461facc3e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:50,209 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(585): clone region=62f7f3bc3f20c01c645d954e3b69abb7 as 62f7f3bc3f20c01c645d954e3b69abb7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:50,209 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(585): clone region=44fcb2a197fd68783177ef7b01cbd259 as 44fcb2a197fd68783177ef7b01cbd259 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:50,209 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(585): clone region=3e263c48eebc5aa48ed5c2a4a4863a12 as 3e263c48eebc5aa48ed5c2a4a4863a12 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 04:03:50,209 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 47629f72f274f163d1ab72258ac4bb3b, NAME => 'testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,211 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => cc7353a5827a0568b6ae928dd1077028, NAME => 'testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,211 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4f5dd40c4622943c4fb4af1a2a0ba82d, NAME => 'testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,211 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 86cc148bad996fa54a1262ed289ea06f, NAME => 'testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,211 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => a6aa62f8f30de3b31afd96d5c1977ff3, NAME => 'testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,211 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 144c9cc6bb8fb7be885f286b99927ebe, NAME => 'testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,212 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => c755ff97300fd153ac6e002461facc3e, NAME => 'testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,214 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 62f7f3bc3f20c01c645d954e3b69abb7, NAME => 'testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,240 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,240 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 144c9cc6bb8fb7be885f286b99927ebe, disabling compactions & flushes 2023-02-13 04:03:50,240 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:50,240 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:50,240 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. after waiting 0 ms 2023-02-13 04:03:50,240 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:50,240 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:50,240 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 144c9cc6bb8fb7be885f286b99927ebe: Waiting for close lock at 1676261030240Disabling compacts and flushes for region at 1676261030240Disabling writes for close at 1676261030240Writing region close event to WAL at 1676261030240Closed at 1676261030240 2023-02-13 04:03:50,241 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 44fcb2a197fd68783177ef7b01cbd259, NAME => 'testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,252 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,252 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 35d0f519d53a41d8ae8951803b942db6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,253 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,253 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink afdff401f1584314b105c9623c3903b4 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,254 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,254 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 891632f9af744dd381952f58dd3c6ab0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,255 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,255 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4236a46e2bf34c28af09ad5e8ea3c473 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,255 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,255 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fd3121296bb84a868e6cafbe688e6fda from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,260 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,260 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,260 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c5f26c98ccff42b996e6c4e5cbb503f9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,260 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing cc7353a5827a0568b6ae928dd1077028, disabling compactions & flushes 2023-02-13 04:03:50,260 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:50,261 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:50,261 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. after waiting 0 ms 2023-02-13 04:03:50,261 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:50,261 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:50,261 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for cc7353a5827a0568b6ae928dd1077028: Waiting for close lock at 1676261030260Disabling compacts and flushes for region at 1676261030260Disabling writes for close at 1676261030261 (+1 ms)Writing region close event to WAL at 1676261030261Closed at 1676261030261 2023-02-13 04:03:50,261 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 697d362b514e4ed89a1a18d7670f4fc0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,261 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1133ebe5c0d64bdfacb4d2fb67fef034 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,261 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 3e263c48eebc5aa48ed5c2a4a4863a12, NAME => 'testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,261 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0ab9a694dcfc42b590bcac28ea8b7aab from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,262 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 153bc34b2c8943618910e8a01fe1f6ae from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,262 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d22f9a0c923141e2b918ece9553a8cc1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 62f7f3bc3f20c01c645d954e3b69abb7, disabling compactions & flushes 2023-02-13 04:03:50,265 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:50,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:50,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. after waiting 0 ms 2023-02-13 04:03:50,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:50,265 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:50,265 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 62f7f3bc3f20c01c645d954e3b69abb7: Waiting for close lock at 1676261030265Disabling compacts and flushes for region at 1676261030265Disabling writes for close at 1676261030265Writing region close event to WAL at 1676261030265Closed at 1676261030265 2023-02-13 04:03:50,272 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 91479c5cabd943a08bf2086d4e1eff09 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,272 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 4f5dd40c4622943c4fb4af1a2a0ba82d, disabling compactions & flushes 2023-02-13 04:03:50,272 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:50,272 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:50,272 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. after waiting 0 ms 2023-02-13 04:03:50,272 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:50,272 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,272 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing a6aa62f8f30de3b31afd96d5c1977ff3, disabling compactions & flushes 2023-02-13 04:03:50,272 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink db5ebc6e352a4d0db661014efe738ead from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,272 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:50,272 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:50,273 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 4f5dd40c4622943c4fb4af1a2a0ba82d: Waiting for close lock at 1676261030272Disabling compacts and flushes for region at 1676261030272Disabling writes for close at 1676261030272Writing region close event to WAL at 1676261030272Closed at 1676261030272 2023-02-13 04:03:50,273 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:50,273 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. after waiting 0 ms 2023-02-13 04:03:50,273 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:50,273 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:50,273 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for a6aa62f8f30de3b31afd96d5c1977ff3: Waiting for close lock at 1676261030272Disabling compacts and flushes for region at 1676261030272Disabling writes for close at 1676261030273 (+1 ms)Writing region close event to WAL at 1676261030273Closed at 1676261030273 2023-02-13 04:03:50,273 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 47629f72f274f163d1ab72258ac4bb3b, disabling compactions & flushes 2023-02-13 04:03:50,273 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:50,273 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:50,274 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. after waiting 0 ms 2023-02-13 04:03:50,274 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:50,274 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing c755ff97300fd153ac6e002461facc3e, disabling compactions & flushes 2023-02-13 04:03:50,274 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:50,274 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:50,274 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 47629f72f274f163d1ab72258ac4bb3b: Waiting for close lock at 1676261030273Disabling compacts and flushes for region at 1676261030273Disabling writes for close at 1676261030274 (+1 ms)Writing region close event to WAL at 1676261030274Closed at 1676261030274 2023-02-13 04:03:50,274 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:50,274 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. after waiting 0 ms 2023-02-13 04:03:50,274 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:50,274 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:50,274 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for c755ff97300fd153ac6e002461facc3e: Waiting for close lock at 1676261030274Disabling compacts and flushes for region at 1676261030274Disabling writes for close at 1676261030274Writing region close event to WAL at 1676261030274Closed at 1676261030274 2023-02-13 04:03:50,275 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 86cc148bad996fa54a1262ed289ea06f, disabling compactions & flushes 2023-02-13 04:03:50,275 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:50,275 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:50,275 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. after waiting 0 ms 2023-02-13 04:03:50,275 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:50,275 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:50,275 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 86cc148bad996fa54a1262ed289ea06f: Waiting for close lock at 1676261030275Disabling compacts and flushes for region at 1676261030275Disabling writes for close at 1676261030275Writing region close event to WAL at 1676261030275Closed at 1676261030275 2023-02-13 04:03:50,276 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bd4b760b97a84458b877375e8fee248b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,283 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,284 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 909e0a97c1894875a45c26cbe336a1d8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,284 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 44fcb2a197fd68783177ef7b01cbd259, disabling compactions & flushes 2023-02-13 04:03:50,284 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:50,284 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:50,284 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. after waiting 0 ms 2023-02-13 04:03:50,284 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:50,284 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:50,284 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 44fcb2a197fd68783177ef7b01cbd259: Waiting for close lock at 1676261030284Disabling compacts and flushes for region at 1676261030284Disabling writes for close at 1676261030284Writing region close event to WAL at 1676261030284Closed at 1676261030284 2023-02-13 04:03:50,286 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e86c2014ab424de68b49fb2ff51203ee from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 04:03:50,287 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 3e263c48eebc5aa48ed5c2a4a4863a12, disabling compactions & flushes 2023-02-13 04:03:50,287 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:50,287 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:50,288 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. after waiting 0 ms 2023-02-13 04:03:50,288 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:50,288 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:50,288 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 3e263c48eebc5aa48ed5c2a4a4863a12: Waiting for close lock at 1676261030287Disabling compacts and flushes for region at 1676261030287Disabling writes for close at 1676261030288 (+1 ms)Writing region close event to WAL at 1676261030288Closed at 1676261030288 2023-02-13 04:03:50,288 INFO [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676261027698 type: FLUSH version: 2 ttl: 0 2023-02-13 04:03:50,288 DEBUG [Listener at localhost/36687] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,288 DEBUG [Listener at localhost/36687] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312 2023-02-13 04:03:50,289 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-data/ 2023-02-13 04:03:50,289 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----default/ 2023-02-13 04:03:50,290 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 04:03:50,290 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----------144c9cc6bb8fb7be885f286b99927ebe/ 2023-02-13 04:03:50,291 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:50,291 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----------3e263c48eebc5aa48ed5c2a4a4863a12/ 2023-02-13 04:03:50,291 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:50,291 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:50,292 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=3e263c48eebc5aa48ed5c2a4a4863a12-909e0a97c1894875a45c26cbe336a1d8 2023-02-13 04:03:50,292 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:50,292 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=3e263c48eebc5aa48ed5c2a4a4863a12-e86c2014ab424de68b49fb2ff51203ee 2023-02-13 04:03:50,292 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----------44fcb2a197fd68783177ef7b01cbd259/ 2023-02-13 04:03:50,293 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:50,293 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:50,293 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=44fcb2a197fd68783177ef7b01cbd259-db5ebc6e352a4d0db661014efe738ead 2023-02-13 04:03:50,293 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:50,294 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=44fcb2a197fd68783177ef7b01cbd259-bd4b760b97a84458b877375e8fee248b 2023-02-13 04:03:50,294 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----------47629f72f274f163d1ab72258ac4bb3b/ 2023-02-13 04:03:50,294 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:50,294 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:50,295 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=47629f72f274f163d1ab72258ac4bb3b-891632f9af744dd381952f58dd3c6ab0 2023-02-13 04:03:50,295 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:50,295 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=47629f72f274f163d1ab72258ac4bb3b-d22f9a0c923141e2b918ece9553a8cc1 2023-02-13 04:03:50,295 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----------4f5dd40c4622943c4fb4af1a2a0ba82d/ 2023-02-13 04:03:50,296 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:50,296 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:50,296 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=4f5dd40c4622943c4fb4af1a2a0ba82d-afdff401f1584314b105c9623c3903b4 2023-02-13 04:03:50,296 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:50,297 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=4f5dd40c4622943c4fb4af1a2a0ba82d-1133ebe5c0d64bdfacb4d2fb67fef034 2023-02-13 04:03:50,297 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----------62f7f3bc3f20c01c645d954e3b69abb7/ 2023-02-13 04:03:50,297 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:50,297 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:50,298 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=62f7f3bc3f20c01c645d954e3b69abb7-35d0f519d53a41d8ae8951803b942db6 2023-02-13 04:03:50,298 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:50,298 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=62f7f3bc3f20c01c645d954e3b69abb7-697d362b514e4ed89a1a18d7670f4fc0 2023-02-13 04:03:50,298 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----------86cc148bad996fa54a1262ed289ea06f/ 2023-02-13 04:03:50,299 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:50,299 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:50,299 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=86cc148bad996fa54a1262ed289ea06f-c5f26c98ccff42b996e6c4e5cbb503f9 2023-02-13 04:03:50,299 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:50,300 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=86cc148bad996fa54a1262ed289ea06f-91479c5cabd943a08bf2086d4e1eff09 2023-02-13 04:03:50,300 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----------a6aa62f8f30de3b31afd96d5c1977ff3/ 2023-02-13 04:03:50,300 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:50,300 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:50,300 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=a6aa62f8f30de3b31afd96d5c1977ff3-fd3121296bb84a868e6cafbe688e6fda 2023-02-13 04:03:50,301 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:50,301 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=a6aa62f8f30de3b31afd96d5c1977ff3-0ab9a694dcfc42b590bcac28ea8b7aab 2023-02-13 04:03:50,301 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----------c755ff97300fd153ac6e002461facc3e/ 2023-02-13 04:03:50,301 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:50,301 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:50,302 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=c755ff97300fd153ac6e002461facc3e-4236a46e2bf34c28af09ad5e8ea3c473 2023-02-13 04:03:50,302 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:50,302 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |----------------testWithMapReduce=c755ff97300fd153ac6e002461facc3e-153bc34b2c8943618910e8a01fe1f6ae 2023-02-13 04:03:50,302 DEBUG [Listener at localhost/36687] util.CommonFSUtils(699): |----------cc7353a5827a0568b6ae928dd1077028/ 2023-02-13 04:03:50,302 DEBUG [Listener at localhost/36687] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:50,303 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,303 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,304 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,304 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,304 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,305 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,305 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,372 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/hadoop-8821982776848504276.jar 2023-02-13 04:03:50,373 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,373 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,374 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,374 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,375 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,375 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,375 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 04:03:50,376 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 04:03:50,376 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 04:03:50,376 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 04:03:50,377 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 04:03:50,377 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 04:03:50,378 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 04:03:50,378 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 04:03:50,378 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 04:03:50,379 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 04:03:50,379 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 04:03:50,379 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 04:03:50,380 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 04:03:50,380 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 04:03:50,380 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 04:03:50,446 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/hadoop-8033615817718562528.jar 2023-02-13 04:03:50,446 DEBUG [Listener at localhost/36687] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 04:03:50,452 WARN [Listener at localhost/36687] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 04:03:50,482 INFO [Listener at localhost/36687] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 04:03:50,589 WARN [Listener at localhost/36687] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/mapreduce.cluster.local.dir/1676261030555/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 04:03:50,589 WARN [Listener at localhost/36687] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/mapreduce.cluster.local.dir/1676261030555/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 04:03:50,623 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,623 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:50,624 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:50,628 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:50,629 DEBUG [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f1 2023-02-13 04:03:50,630 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e263c48eebc5aa48ed5c2a4a4863a12 columnFamilyName f1 2023-02-13 04:03:50,635 DEBUG [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f1/testWithMapReduce=3e263c48eebc5aa48ed5c2a4a4863a12-909e0a97c1894875a45c26cbe336a1d8 2023-02-13 04:03:50,635 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] regionserver.HStore(310): Store=3e263c48eebc5aa48ed5c2a4a4863a12/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,635 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e263c48eebc5aa48ed5c2a4a4863a12 2023-02-13 04:03:50,636 DEBUG [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f2 2023-02-13 04:03:50,636 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e263c48eebc5aa48ed5c2a4a4863a12 columnFamilyName f2 2023-02-13 04:03:50,641 DEBUG [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/3e263c48eebc5aa48ed5c2a4a4863a12/f2/testWithMapReduce=3e263c48eebc5aa48ed5c2a4a4863a12-e86c2014ab424de68b49fb2ff51203ee 2023-02-13 04:03:50,641 INFO [StoreOpener-3e263c48eebc5aa48ed5c2a4a4863a12-1] regionserver.HStore(310): Store=3e263c48eebc5aa48ed5c2a4a4863a12/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:50,641 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3e263c48eebc5aa48ed5c2a4a4863a12; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65223205, jitterRate=-0.028098508715629578}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:50,641 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3e263c48eebc5aa48ed5c2a4a4863a12: Writing region info on filesystem at 1676261030624Initializing all the Stores at 1676261030625 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030625Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030628 (+3 ms)Region opened successfully at 1676261030641 (+13 ms) 2023-02-13 04:03:50,672 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3e263c48eebc5aa48ed5c2a4a4863a12, disabling compactions & flushes 2023-02-13 04:03:50,672 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:50,673 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:50,673 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. after waiting 0 ms 2023-02-13 04:03:50,673 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:50,673 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676261026298.3e263c48eebc5aa48ed5c2a4a4863a12. 2023-02-13 04:03:50,673 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3e263c48eebc5aa48ed5c2a4a4863a12: Waiting for close lock at 1676261030672Disabling compacts and flushes for region at 1676261030672Disabling writes for close at 1676261030673 (+1 ms)Writing region close event to WAL at 1676261030673Closed at 1676261030673 2023-02-13 04:03:50,676 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,676 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:50,678 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:50,680 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:50,681 DEBUG [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe/f1 2023-02-13 04:03:50,682 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 144c9cc6bb8fb7be885f286b99927ebe columnFamilyName f1 2023-02-13 04:03:50,682 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] regionserver.HStore(310): Store=144c9cc6bb8fb7be885f286b99927ebe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,682 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 144c9cc6bb8fb7be885f286b99927ebe 2023-02-13 04:03:50,683 DEBUG [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/144c9cc6bb8fb7be885f286b99927ebe/f2 2023-02-13 04:03:50,684 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 144c9cc6bb8fb7be885f286b99927ebe columnFamilyName f2 2023-02-13 04:03:50,684 INFO [StoreOpener-144c9cc6bb8fb7be885f286b99927ebe-1] regionserver.HStore(310): Store=144c9cc6bb8fb7be885f286b99927ebe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,684 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:50,684 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 144c9cc6bb8fb7be885f286b99927ebe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60194226, jitterRate=-0.10303613543510437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:50,685 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 144c9cc6bb8fb7be885f286b99927ebe: Writing region info on filesystem at 1676261030678Initializing all the Stores at 1676261030679 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030679Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030679Region opened successfully at 1676261030685 (+6 ms) 2023-02-13 04:03:50,701 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 144c9cc6bb8fb7be885f286b99927ebe, disabling compactions & flushes 2023-02-13 04:03:50,701 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:50,701 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:50,701 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. after waiting 0 ms 2023-02-13 04:03:50,701 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:50,702 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676261026298.144c9cc6bb8fb7be885f286b99927ebe. 2023-02-13 04:03:50,702 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 144c9cc6bb8fb7be885f286b99927ebe: Waiting for close lock at 1676261030701Disabling compacts and flushes for region at 1676261030701Disabling writes for close at 1676261030701Writing region close event to WAL at 1676261030702 (+1 ms)Closed at 1676261030702 2023-02-13 04:03:50,705 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,705 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:50,709 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:50,711 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:50,712 DEBUG [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f1 2023-02-13 04:03:50,712 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f5dd40c4622943c4fb4af1a2a0ba82d columnFamilyName f1 2023-02-13 04:03:50,717 DEBUG [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f1/testWithMapReduce=4f5dd40c4622943c4fb4af1a2a0ba82d-afdff401f1584314b105c9623c3903b4 2023-02-13 04:03:50,717 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] regionserver.HStore(310): Store=4f5dd40c4622943c4fb4af1a2a0ba82d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,717 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4f5dd40c4622943c4fb4af1a2a0ba82d 2023-02-13 04:03:50,718 DEBUG [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f2 2023-02-13 04:03:50,718 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f5dd40c4622943c4fb4af1a2a0ba82d columnFamilyName f2 2023-02-13 04:03:50,757 DEBUG [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/4f5dd40c4622943c4fb4af1a2a0ba82d/f2/testWithMapReduce=4f5dd40c4622943c4fb4af1a2a0ba82d-1133ebe5c0d64bdfacb4d2fb67fef034 2023-02-13 04:03:50,757 INFO [StoreOpener-4f5dd40c4622943c4fb4af1a2a0ba82d-1] regionserver.HStore(310): Store=4f5dd40c4622943c4fb4af1a2a0ba82d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,758 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:50,758 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4f5dd40c4622943c4fb4af1a2a0ba82d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66957894, jitterRate=-0.0022496283054351807}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:50,758 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4f5dd40c4622943c4fb4af1a2a0ba82d: Writing region info on filesystem at 1676261030709Initializing all the Stores at 1676261030710 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030710Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030710Region opened successfully at 1676261030758 (+48 ms) 2023-02-13 04:03:50,801 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4f5dd40c4622943c4fb4af1a2a0ba82d, disabling compactions & flushes 2023-02-13 04:03:50,801 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:50,801 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:50,801 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. after waiting 0 ms 2023-02-13 04:03:50,801 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:50,802 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676261026298.4f5dd40c4622943c4fb4af1a2a0ba82d. 2023-02-13 04:03:50,802 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4f5dd40c4622943c4fb4af1a2a0ba82d: Waiting for close lock at 1676261030800Disabling compacts and flushes for region at 1676261030800Disabling writes for close at 1676261030801 (+1 ms)Writing region close event to WAL at 1676261030802 (+1 ms)Closed at 1676261030802 2023-02-13 04:03:50,805 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,805 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:50,806 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:50,808 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:50,810 DEBUG [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f1 2023-02-13 04:03:50,810 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62f7f3bc3f20c01c645d954e3b69abb7 columnFamilyName f1 2023-02-13 04:03:50,815 DEBUG [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f1/testWithMapReduce=62f7f3bc3f20c01c645d954e3b69abb7-35d0f519d53a41d8ae8951803b942db6 2023-02-13 04:03:50,815 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] regionserver.HStore(310): Store=62f7f3bc3f20c01c645d954e3b69abb7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,815 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 62f7f3bc3f20c01c645d954e3b69abb7 2023-02-13 04:03:50,816 DEBUG [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f2 2023-02-13 04:03:50,816 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62f7f3bc3f20c01c645d954e3b69abb7 columnFamilyName f2 2023-02-13 04:03:50,820 DEBUG [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/62f7f3bc3f20c01c645d954e3b69abb7/f2/testWithMapReduce=62f7f3bc3f20c01c645d954e3b69abb7-697d362b514e4ed89a1a18d7670f4fc0 2023-02-13 04:03:50,821 INFO [StoreOpener-62f7f3bc3f20c01c645d954e3b69abb7-1] regionserver.HStore(310): Store=62f7f3bc3f20c01c645d954e3b69abb7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,821 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:50,821 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 62f7f3bc3f20c01c645d954e3b69abb7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74529786, jitterRate=0.11058035492897034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:50,821 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 62f7f3bc3f20c01c645d954e3b69abb7: Writing region info on filesystem at 1676261030806Initializing all the Stores at 1676261030807 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030807Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030808 (+1 ms)Region opened successfully at 1676261030821 (+13 ms) 2023-02-13 04:03:50,865 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 62f7f3bc3f20c01c645d954e3b69abb7, disabling compactions & flushes 2023-02-13 04:03:50,865 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:50,865 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:50,865 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. after waiting 0 ms 2023-02-13 04:03:50,866 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:50,866 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676261026298.62f7f3bc3f20c01c645d954e3b69abb7. 2023-02-13 04:03:50,866 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 62f7f3bc3f20c01c645d954e3b69abb7: Waiting for close lock at 1676261030865Disabling compacts and flushes for region at 1676261030865Disabling writes for close at 1676261030866 (+1 ms)Writing region close event to WAL at 1676261030866Closed at 1676261030866 2023-02-13 04:03:50,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,870 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:50,871 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:50,873 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:50,873 DEBUG [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f1 2023-02-13 04:03:50,874 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6aa62f8f30de3b31afd96d5c1977ff3 columnFamilyName f1 2023-02-13 04:03:50,878 DEBUG [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f1/testWithMapReduce=a6aa62f8f30de3b31afd96d5c1977ff3-fd3121296bb84a868e6cafbe688e6fda 2023-02-13 04:03:50,878 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] regionserver.HStore(310): Store=a6aa62f8f30de3b31afd96d5c1977ff3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,878 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a6aa62f8f30de3b31afd96d5c1977ff3 2023-02-13 04:03:50,879 DEBUG [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f2 2023-02-13 04:03:50,879 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6aa62f8f30de3b31afd96d5c1977ff3 columnFamilyName f2 2023-02-13 04:03:50,883 DEBUG [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/a6aa62f8f30de3b31afd96d5c1977ff3/f2/testWithMapReduce=a6aa62f8f30de3b31afd96d5c1977ff3-0ab9a694dcfc42b590bcac28ea8b7aab 2023-02-13 04:03:50,883 INFO [StoreOpener-a6aa62f8f30de3b31afd96d5c1977ff3-1] regionserver.HStore(310): Store=a6aa62f8f30de3b31afd96d5c1977ff3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,884 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:50,884 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a6aa62f8f30de3b31afd96d5c1977ff3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65892040, jitterRate=-0.01813209056854248}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:50,884 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a6aa62f8f30de3b31afd96d5c1977ff3: Writing region info on filesystem at 1676261030871Initializing all the Stores at 1676261030872 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030872Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030872Region opened successfully at 1676261030884 (+12 ms) 2023-02-13 04:03:50,914 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a6aa62f8f30de3b31afd96d5c1977ff3, disabling compactions & flushes 2023-02-13 04:03:50,914 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:50,914 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:50,914 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. after waiting 0 ms 2023-02-13 04:03:50,914 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:50,915 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676261026298.a6aa62f8f30de3b31afd96d5c1977ff3. 2023-02-13 04:03:50,915 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a6aa62f8f30de3b31afd96d5c1977ff3: Waiting for close lock at 1676261030914Disabling compacts and flushes for region at 1676261030914Disabling writes for close at 1676261030914Writing region close event to WAL at 1676261030915 (+1 ms)Closed at 1676261030915 2023-02-13 04:03:50,918 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,918 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:50,920 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:50,921 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:50,922 DEBUG [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f1 2023-02-13 04:03:50,922 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47629f72f274f163d1ab72258ac4bb3b columnFamilyName f1 2023-02-13 04:03:50,927 DEBUG [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f1/testWithMapReduce=47629f72f274f163d1ab72258ac4bb3b-891632f9af744dd381952f58dd3c6ab0 2023-02-13 04:03:50,927 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] regionserver.HStore(310): Store=47629f72f274f163d1ab72258ac4bb3b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,927 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 47629f72f274f163d1ab72258ac4bb3b 2023-02-13 04:03:50,928 DEBUG [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f2 2023-02-13 04:03:50,928 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47629f72f274f163d1ab72258ac4bb3b columnFamilyName f2 2023-02-13 04:03:50,932 DEBUG [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/47629f72f274f163d1ab72258ac4bb3b/f2/testWithMapReduce=47629f72f274f163d1ab72258ac4bb3b-d22f9a0c923141e2b918ece9553a8cc1 2023-02-13 04:03:50,933 INFO [StoreOpener-47629f72f274f163d1ab72258ac4bb3b-1] regionserver.HStore(310): Store=47629f72f274f163d1ab72258ac4bb3b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:50,933 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 47629f72f274f163d1ab72258ac4bb3b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64925670, jitterRate=-0.03253212571144104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:50,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 47629f72f274f163d1ab72258ac4bb3b: Writing region info on filesystem at 1676261030920Initializing all the Stores at 1676261030921 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030921Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030921Region opened successfully at 1676261030933 (+12 ms) 2023-02-13 04:03:50,960 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 47629f72f274f163d1ab72258ac4bb3b, disabling compactions & flushes 2023-02-13 04:03:50,960 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:50,961 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:50,961 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. after waiting 0 ms 2023-02-13 04:03:50,961 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:50,961 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676261026298.47629f72f274f163d1ab72258ac4bb3b. 2023-02-13 04:03:50,961 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 47629f72f274f163d1ab72258ac4bb3b: Waiting for close lock at 1676261030960Disabling compacts and flushes for region at 1676261030960Disabling writes for close at 1676261030961 (+1 ms)Writing region close event to WAL at 1676261030961Closed at 1676261030961 2023-02-13 04:03:50,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:50,964 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:50,965 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:50,967 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:50,968 DEBUG [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f1 2023-02-13 04:03:50,968 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86cc148bad996fa54a1262ed289ea06f columnFamilyName f1 2023-02-13 04:03:50,973 DEBUG [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f1/testWithMapReduce=86cc148bad996fa54a1262ed289ea06f-c5f26c98ccff42b996e6c4e5cbb503f9 2023-02-13 04:03:50,973 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] regionserver.HStore(310): Store=86cc148bad996fa54a1262ed289ea06f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,973 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 86cc148bad996fa54a1262ed289ea06f 2023-02-13 04:03:50,974 DEBUG [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f2 2023-02-13 04:03:50,974 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86cc148bad996fa54a1262ed289ea06f columnFamilyName f2 2023-02-13 04:03:50,979 DEBUG [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/86cc148bad996fa54a1262ed289ea06f/f2/testWithMapReduce=86cc148bad996fa54a1262ed289ea06f-91479c5cabd943a08bf2086d4e1eff09 2023-02-13 04:03:50,979 INFO [StoreOpener-86cc148bad996fa54a1262ed289ea06f-1] regionserver.HStore(310): Store=86cc148bad996fa54a1262ed289ea06f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:50,980 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:50,980 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 86cc148bad996fa54a1262ed289ea06f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67807181, jitterRate=0.010405734181404114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:50,980 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 86cc148bad996fa54a1262ed289ea06f: Writing region info on filesystem at 1676261030965Initializing all the Stores at 1676261030966 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030966Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261030966Region opened successfully at 1676261030980 (+14 ms) 2023-02-13 04:03:51,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 86cc148bad996fa54a1262ed289ea06f, disabling compactions & flushes 2023-02-13 04:03:51,011 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:51,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:51,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. after waiting 0 ms 2023-02-13 04:03:51,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:51,012 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676261026298.86cc148bad996fa54a1262ed289ea06f. 2023-02-13 04:03:51,012 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 86cc148bad996fa54a1262ed289ea06f: Waiting for close lock at 1676261031011Disabling compacts and flushes for region at 1676261031011Disabling writes for close at 1676261031011Writing region close event to WAL at 1676261031012 (+1 ms)Closed at 1676261031012 2023-02-13 04:03:51,015 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:51,015 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:51,017 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:51,019 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:51,020 DEBUG [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028/f1 2023-02-13 04:03:51,021 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc7353a5827a0568b6ae928dd1077028 columnFamilyName f1 2023-02-13 04:03:51,021 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] regionserver.HStore(310): Store=cc7353a5827a0568b6ae928dd1077028/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:51,021 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cc7353a5827a0568b6ae928dd1077028 2023-02-13 04:03:51,022 DEBUG [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/cc7353a5827a0568b6ae928dd1077028/f2 2023-02-13 04:03:51,023 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc7353a5827a0568b6ae928dd1077028 columnFamilyName f2 2023-02-13 04:03:51,023 INFO [StoreOpener-cc7353a5827a0568b6ae928dd1077028-1] regionserver.HStore(310): Store=cc7353a5827a0568b6ae928dd1077028/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:51,023 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:51,023 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cc7353a5827a0568b6ae928dd1077028; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58767196, jitterRate=-0.12430053949356079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:51,023 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cc7353a5827a0568b6ae928dd1077028: Writing region info on filesystem at 1676261031017Initializing all the Stores at 1676261031018 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261031018Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261031018Region opened successfully at 1676261031023 (+5 ms) 2023-02-13 04:03:51,048 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cc7353a5827a0568b6ae928dd1077028, disabling compactions & flushes 2023-02-13 04:03:51,048 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:51,048 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:51,048 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. after waiting 0 ms 2023-02-13 04:03:51,048 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:51,049 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261026298.cc7353a5827a0568b6ae928dd1077028. 2023-02-13 04:03:51,049 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cc7353a5827a0568b6ae928dd1077028: Waiting for close lock at 1676261031048Disabling compacts and flushes for region at 1676261031048Disabling writes for close at 1676261031048Writing region close event to WAL at 1676261031049 (+1 ms)Closed at 1676261031049 2023-02-13 04:03:51,052 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:51,052 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:51,054 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:51,055 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:51,056 DEBUG [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f1 2023-02-13 04:03:51,057 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44fcb2a197fd68783177ef7b01cbd259 columnFamilyName f1 2023-02-13 04:03:51,062 DEBUG [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f1/testWithMapReduce=44fcb2a197fd68783177ef7b01cbd259-db5ebc6e352a4d0db661014efe738ead 2023-02-13 04:03:51,062 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] regionserver.HStore(310): Store=44fcb2a197fd68783177ef7b01cbd259/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:51,062 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 44fcb2a197fd68783177ef7b01cbd259 2023-02-13 04:03:51,063 DEBUG [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f2 2023-02-13 04:03:51,064 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44fcb2a197fd68783177ef7b01cbd259 columnFamilyName f2 2023-02-13 04:03:51,069 DEBUG [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/44fcb2a197fd68783177ef7b01cbd259/f2/testWithMapReduce=44fcb2a197fd68783177ef7b01cbd259-bd4b760b97a84458b877375e8fee248b 2023-02-13 04:03:51,069 INFO [StoreOpener-44fcb2a197fd68783177ef7b01cbd259-1] regionserver.HStore(310): Store=44fcb2a197fd68783177ef7b01cbd259/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:51,070 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:51,070 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 44fcb2a197fd68783177ef7b01cbd259; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70488952, jitterRate=0.05036723613739014}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:51,070 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 44fcb2a197fd68783177ef7b01cbd259: Writing region info on filesystem at 1676261031054Initializing all the Stores at 1676261031054Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261031055 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261031055Region opened successfully at 1676261031070 (+15 ms) 2023-02-13 04:03:51,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 44fcb2a197fd68783177ef7b01cbd259, disabling compactions & flushes 2023-02-13 04:03:51,100 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:51,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:51,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. after waiting 0 ms 2023-02-13 04:03:51,101 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:51,103 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676261026298.44fcb2a197fd68783177ef7b01cbd259. 2023-02-13 04:03:51,103 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 44fcb2a197fd68783177ef7b01cbd259: Waiting for close lock at 1676261031100Disabling compacts and flushes for region at 1676261031100Disabling writes for close at 1676261031101 (+1 ms)Writing region close event to WAL at 1676261031103 (+2 ms)Closed at 1676261031103 2023-02-13 04:03:51,105 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:51,106 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:03:51,107 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:51,109 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:51,110 DEBUG [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f1 2023-02-13 04:03:51,110 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c755ff97300fd153ac6e002461facc3e columnFamilyName f1 2023-02-13 04:03:51,115 DEBUG [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f1/testWithMapReduce=c755ff97300fd153ac6e002461facc3e-4236a46e2bf34c28af09ad5e8ea3c473 2023-02-13 04:03:51,115 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] regionserver.HStore(310): Store=c755ff97300fd153ac6e002461facc3e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:51,115 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c755ff97300fd153ac6e002461facc3e 2023-02-13 04:03:51,116 DEBUG [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f2 2023-02-13 04:03:51,116 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c755ff97300fd153ac6e002461facc3e columnFamilyName f2 2023-02-13 04:03:51,121 DEBUG [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] regionserver.HStore(539): loaded hdfs://localhost:33645/user/jenkins/test-data/ac29b474-858e-333c-3bc3-26e9b910d8af/testWithMapReduceAndOfflineHBaseMultiRegion/e9966323-0e28-4c48-b1bc-a8904abd7312/data/default/testWithMapReduce/c755ff97300fd153ac6e002461facc3e/f2/testWithMapReduce=c755ff97300fd153ac6e002461facc3e-153bc34b2c8943618910e8a01fe1f6ae 2023-02-13 04:03:51,121 INFO [StoreOpener-c755ff97300fd153ac6e002461facc3e-1] regionserver.HStore(310): Store=c755ff97300fd153ac6e002461facc3e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:51,121 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:51,122 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c755ff97300fd153ac6e002461facc3e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66638067, jitterRate=-0.007015421986579895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:51,122 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c755ff97300fd153ac6e002461facc3e: Writing region info on filesystem at 1676261031107Initializing all the Stores at 1676261031107Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261031108 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261031108Region opened successfully at 1676261031122 (+14 ms) 2023-02-13 04:03:51,150 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c755ff97300fd153ac6e002461facc3e, disabling compactions & flushes 2023-02-13 04:03:51,150 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:51,150 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:51,150 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. after waiting 0 ms 2023-02-13 04:03:51,150 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:51,151 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676261026298.c755ff97300fd153ac6e002461facc3e. 2023-02-13 04:03:51,151 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c755ff97300fd153ac6e002461facc3e: Waiting for close lock at 1676261031150Disabling compacts and flushes for region at 1676261031150Disabling writes for close at 1676261031150Writing region close event to WAL at 1676261031151 (+1 ms)Closed at 1676261031151 2023-02-13 04:03:51,624 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 04:03:51,625 WARN [Listener at localhost/36687] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:03:51,628 INFO [Listener at localhost/36687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:03:51,732 WARN [BP-1038825902-172.31.14.131-1676261023856 heartbeating to localhost/127.0.0.1:33645] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:03:51,732 WARN [BP-1038825902-172.31.14.131-1676261023856 heartbeating to localhost/127.0.0.1:33645] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1038825902-172.31.14.131-1676261023856 (Datanode Uuid a6411c56-34e1-44f3-a8a5-7593ae06f6ae) service to localhost/127.0.0.1:33645 2023-02-13 04:03:51,733 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/cluster_769789a9-472d-7750-b833-a89cbb41e651/dfs/data/data3/current/BP-1038825902-172.31.14.131-1676261023856] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:51,733 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/cluster_769789a9-472d-7750-b833-a89cbb41e651/dfs/data/data4/current/BP-1038825902-172.31.14.131-1676261023856] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:51,735 WARN [Listener at localhost/36687] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:03:51,739 INFO [Listener at localhost/36687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:03:51,843 WARN [BP-1038825902-172.31.14.131-1676261023856 heartbeating to localhost/127.0.0.1:33645] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:03:51,843 WARN [BP-1038825902-172.31.14.131-1676261023856 heartbeating to localhost/127.0.0.1:33645] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1038825902-172.31.14.131-1676261023856 (Datanode Uuid 507f40ec-55cd-4775-9533-fffccbd2aa9a) service to localhost/127.0.0.1:33645 2023-02-13 04:03:51,844 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/cluster_769789a9-472d-7750-b833-a89cbb41e651/dfs/data/data1/current/BP-1038825902-172.31.14.131-1676261023856] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:51,844 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/cluster_769789a9-472d-7750-b833-a89cbb41e651/dfs/data/data2/current/BP-1038825902-172.31.14.131-1676261023856] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:51,853 INFO [Listener at localhost/36687] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:03:51,975 INFO [Listener at localhost/36687] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 04:03:52,018 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 04:03:52,033 INFO [Listener at localhost/36687] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=159 (was 104) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33645 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34675,1676261024674)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33645 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:33645 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36687 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33645 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:33645 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:33645 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33645 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=535 (was 547), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=261 (was 238) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3961 (was 4201) 2023-02-13 04:03:52,043 INFO [Listener at localhost/36687] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=159, OpenFileDescriptor=535, MaxFileDescriptor=60000, SystemLoadAverage=261, ProcessCount=168, AvailableMemoryMB=3961 2023-02-13 04:03:52,053 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/hadoop.log.dir so I do NOT create it in target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d 2023-02-13 04:03:52,053 WARN [Listener at localhost/36687] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 04:03:52,053 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/hadoop.tmp.dir so I do NOT create it in target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d 2023-02-13 04:03:52,053 WARN [Listener at localhost/36687] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a1605ccc-ab35-97c9-f2a9-48ccff746162/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 04:03:52,053 DEBUG [Listener at localhost/36687] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d 2023-02-13 04:03:52,053 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 04:03:52,053 INFO [Listener at localhost/36687] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/cluster_4b2d3994-d374-6947-03e8-8998e82dae97, deleteOnExit=true 2023-02-13 04:03:52,053 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 04:03:52,054 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/test.cache.data in system properties and HBase conf 2023-02-13 04:03:52,054 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 04:03:52,054 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/hadoop.log.dir in system properties and HBase conf 2023-02-13 04:03:52,054 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 04:03:52,054 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 04:03:52,054 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 04:03:52,054 DEBUG [Listener at localhost/36687] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 04:03:52,054 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:03:52,054 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/nfs.dump.dir in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/java.io.tmpdir in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:03:52,055 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 04:03:52,056 INFO [Listener at localhost/36687] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 04:03:52,059 WARN [Listener at localhost/36687] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:03:52,060 WARN [Listener at localhost/36687] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:03:52,097 WARN [Listener at localhost/36687] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:52,099 INFO [Listener at localhost/36687] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:52,104 INFO [Listener at localhost/36687] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/java.io.tmpdir/Jetty_localhost_38787_hdfs____.lmrbs5/webapp 2023-02-13 04:03:52,196 INFO [Listener at localhost/36687] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38787 2023-02-13 04:03:52,200 WARN [Listener at localhost/36687] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:03:52,201 WARN [Listener at localhost/36687] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:03:52,242 WARN [Listener at localhost/42061] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:52,255 WARN [Listener at localhost/42061] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 04:03:52,313 WARN [Listener at localhost/42061] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:03:52,315 WARN [Listener at localhost/42061] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:52,317 INFO [Listener at localhost/42061] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:52,321 INFO [Listener at localhost/42061] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/java.io.tmpdir/Jetty_localhost_38537_datanode____.b6d4jp/webapp 2023-02-13 04:03:52,412 INFO [Listener at localhost/42061] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38537 2023-02-13 04:03:52,419 WARN [Listener at localhost/40749] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:52,436 WARN [Listener at localhost/40749] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:03:52,439 WARN [Listener at localhost/40749] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:52,440 INFO [Listener at localhost/40749] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:52,446 INFO [Listener at localhost/40749] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/java.io.tmpdir/Jetty_localhost_38181_datanode____igr7bg/webapp 2023-02-13 04:03:52,524 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf3b3bbada93fcbe6: Processing first storage report for DS-79aa42c4-ca62-446b-b62b-1609b7e861ca from datanode 63414c1f-8031-4832-9196-87d91fad4776 2023-02-13 04:03:52,524 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf3b3bbada93fcbe6: from storage DS-79aa42c4-ca62-446b-b62b-1609b7e861ca node DatanodeRegistration(127.0.0.1:34097, datanodeUuid=63414c1f-8031-4832-9196-87d91fad4776, infoPort=40431, infoSecurePort=0, ipcPort=40749, storageInfo=lv=-57;cid=testClusterID;nsid=916016267;c=1676261032062), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:52,524 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf3b3bbada93fcbe6: Processing first storage report for DS-2623340e-7264-4c2d-b932-7c36827cb2ac from datanode 63414c1f-8031-4832-9196-87d91fad4776 2023-02-13 04:03:52,524 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf3b3bbada93fcbe6: from storage DS-2623340e-7264-4c2d-b932-7c36827cb2ac node DatanodeRegistration(127.0.0.1:34097, datanodeUuid=63414c1f-8031-4832-9196-87d91fad4776, infoPort=40431, infoSecurePort=0, ipcPort=40749, storageInfo=lv=-57;cid=testClusterID;nsid=916016267;c=1676261032062), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:52,550 INFO [Listener at localhost/40749] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38181 2023-02-13 04:03:52,557 WARN [Listener at localhost/37903] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:52,644 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc35be66f4fdfe018: Processing first storage report for DS-c1941585-abbd-49c5-b062-559abebaee9d from datanode 8e44ba37-4db8-4829-ba6d-284df70486f5 2023-02-13 04:03:52,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc35be66f4fdfe018: from storage DS-c1941585-abbd-49c5-b062-559abebaee9d node DatanodeRegistration(127.0.0.1:36783, datanodeUuid=8e44ba37-4db8-4829-ba6d-284df70486f5, infoPort=35369, infoSecurePort=0, ipcPort=37903, storageInfo=lv=-57;cid=testClusterID;nsid=916016267;c=1676261032062), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:52,644 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc35be66f4fdfe018: Processing first storage report for DS-704b6fa6-08fb-4cf7-ac76-bd4cbf1321af from datanode 8e44ba37-4db8-4829-ba6d-284df70486f5 2023-02-13 04:03:52,644 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc35be66f4fdfe018: from storage DS-704b6fa6-08fb-4cf7-ac76-bd4cbf1321af node DatanodeRegistration(127.0.0.1:36783, datanodeUuid=8e44ba37-4db8-4829-ba6d-284df70486f5, infoPort=35369, infoSecurePort=0, ipcPort=37903, storageInfo=lv=-57;cid=testClusterID;nsid=916016267;c=1676261032062), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:52,668 DEBUG [Listener at localhost/37903] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d 2023-02-13 04:03:52,670 INFO [Listener at localhost/37903] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/cluster_4b2d3994-d374-6947-03e8-8998e82dae97/zookeeper_0, clientPort=62833, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/cluster_4b2d3994-d374-6947-03e8-8998e82dae97/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/cluster_4b2d3994-d374-6947-03e8-8998e82dae97/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 04:03:52,671 INFO [Listener at localhost/37903] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62833 2023-02-13 04:03:52,671 INFO [Listener at localhost/37903] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,672 INFO [Listener at localhost/37903] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,685 INFO [Listener at localhost/37903] util.FSUtils(479): Created version file at hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7 with version=8 2023-02-13 04:03:52,685 INFO [Listener at localhost/37903] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,686 INFO [Listener at localhost/37903] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,687 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42061/user/jenkins/test-data/f82b856d-3c79-d04c-a76c-ac42555dc924/hbase-staging 2023-02-13 04:03:52,689 INFO [Listener at localhost/37903] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:52,689 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:52,689 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:52,689 INFO [Listener at localhost/37903] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:52,689 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:52,689 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:52,689 INFO [Listener at localhost/37903] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:52,691 INFO [Listener at localhost/37903] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39703 2023-02-13 04:03:52,691 INFO [Listener at localhost/37903] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,692 INFO [Listener at localhost/37903] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,693 INFO [Listener at localhost/37903] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39703 connecting to ZooKeeper ensemble=127.0.0.1:62833 2023-02-13 04:03:52,700 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:397030x0, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:52,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39703-0x1004bd96ca20000 connected 2023-02-13 04:03:52,717 DEBUG [Listener at localhost/37903] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:52,717 DEBUG [Listener at localhost/37903] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:52,718 DEBUG [Listener at localhost/37903] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:52,720 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39703 2023-02-13 04:03:52,720 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39703 2023-02-13 04:03:52,724 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39703 2023-02-13 04:03:52,724 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39703 2023-02-13 04:03:52,724 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39703 2023-02-13 04:03:52,725 INFO [Listener at localhost/37903] master.HMaster(439): hbase.rootdir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7, hbase.cluster.distributed=false 2023-02-13 04:03:52,737 INFO [Listener at localhost/37903] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:52,737 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:52,737 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:52,737 INFO [Listener at localhost/37903] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:52,737 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:52,737 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:52,737 INFO [Listener at localhost/37903] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:52,739 INFO [Listener at localhost/37903] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42471 2023-02-13 04:03:52,739 INFO [Listener at localhost/37903] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:03:52,743 DEBUG [Listener at localhost/37903] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:52,743 INFO [Listener at localhost/37903] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,744 INFO [Listener at localhost/37903] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,745 INFO [Listener at localhost/37903] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42471 connecting to ZooKeeper ensemble=127.0.0.1:62833 2023-02-13 04:03:52,748 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:424710x0, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:52,749 DEBUG [Listener at localhost/37903] zookeeper.ZKUtil(164): regionserver:424710x0, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:52,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42471-0x1004bd96ca20001 connected 2023-02-13 04:03:52,750 DEBUG [Listener at localhost/37903] zookeeper.ZKUtil(164): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:52,750 DEBUG [Listener at localhost/37903] zookeeper.ZKUtil(164): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:52,751 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42471 2023-02-13 04:03:52,751 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42471 2023-02-13 04:03:52,752 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42471 2023-02-13 04:03:52,756 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42471 2023-02-13 04:03:52,756 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42471 2023-02-13 04:03:52,768 INFO [Listener at localhost/37903] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:52,768 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:52,769 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:52,769 INFO [Listener at localhost/37903] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:52,769 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:52,769 INFO [Listener at localhost/37903] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:52,769 INFO [Listener at localhost/37903] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:52,774 INFO [Listener at localhost/37903] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33279 2023-02-13 04:03:52,775 INFO [Listener at localhost/37903] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:03:52,775 DEBUG [Listener at localhost/37903] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:52,776 INFO [Listener at localhost/37903] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,777 INFO [Listener at localhost/37903] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,778 INFO [Listener at localhost/37903] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33279 connecting to ZooKeeper ensemble=127.0.0.1:62833 2023-02-13 04:03:52,781 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:332790x0, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:52,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33279-0x1004bd96ca20002 connected 2023-02-13 04:03:52,784 DEBUG [Listener at localhost/37903] zookeeper.ZKUtil(164): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:52,784 DEBUG [Listener at localhost/37903] zookeeper.ZKUtil(164): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:52,785 DEBUG [Listener at localhost/37903] zookeeper.ZKUtil(164): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:52,788 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33279 2023-02-13 04:03:52,788 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33279 2023-02-13 04:03:52,789 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33279 2023-02-13 04:03:52,790 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33279 2023-02-13 04:03:52,820 DEBUG [Listener at localhost/37903] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33279 2023-02-13 04:03:52,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39703,1676261032689 2023-02-13 04:03:52,830 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:03:52,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39703,1676261032689 2023-02-13 04:03:52,832 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:52,832 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:52,832 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:52,832 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:52,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:03:52,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39703,1676261032689 from backup master directory 2023-02-13 04:03:52,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:03:52,836 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39703,1676261032689 2023-02-13 04:03:52,836 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:03:52,836 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:52,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39703,1676261032689 2023-02-13 04:03:52,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/hbase.id with ID: 0316e2fd-8eb6-4d1c-8d83-8adadb3ad6d9 2023-02-13 04:03:52,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:52,864 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:52,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x34d2ef00 to 127.0.0.1:62833 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:52,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c260f50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:52,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:52,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 04:03:52,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:52,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/data/master/store-tmp 2023-02-13 04:03:52,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:52,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:03:52,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:52,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:52,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:03:52,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:52,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:52,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261032890Disabling compacts and flushes for region at 1676261032890Disabling writes for close at 1676261032890Writing region close event to WAL at 1676261032890Closed at 1676261032890 2023-02-13 04:03:52,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/WALs/jenkins-hbase4.apache.org,39703,1676261032689 2023-02-13 04:03:52,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39703%2C1676261032689, suffix=, logDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/WALs/jenkins-hbase4.apache.org,39703,1676261032689, archiveDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/oldWALs, maxLogs=10 2023-02-13 04:03:52,910 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34097,DS-79aa42c4-ca62-446b-b62b-1609b7e861ca,DISK] 2023-02-13 04:03:52,912 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36783,DS-c1941585-abbd-49c5-b062-559abebaee9d,DISK] 2023-02-13 04:03:52,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/WALs/jenkins-hbase4.apache.org,39703,1676261032689/jenkins-hbase4.apache.org%2C39703%2C1676261032689.1676261032894 2023-02-13 04:03:52,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34097,DS-79aa42c4-ca62-446b-b62b-1609b7e861ca,DISK], DatanodeInfoWithStorage[127.0.0.1:36783,DS-c1941585-abbd-49c5-b062-559abebaee9d,DISK]] 2023-02-13 04:03:52,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:52,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:52,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:52,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:52,919 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:52,920 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 04:03:52,920 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 04:03:52,921 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:52,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:52,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:52,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:52,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:52,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61734439, jitterRate=-0.08008517324924469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:03:52,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676261032916Initializing all the Stores at 1676261032917 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261032917Cleaning up temporary data from old regions at 1676261032922 (+5 ms)Cleaning up detritus from prior splits at 1676261032922Region opened successfully at 1676261032926 (+4 ms) 2023-02-13 04:03:52,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 04:03:52,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 04:03:52,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 04:03:52,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 04:03:52,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 04:03:52,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 04:03:52,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 04:03:52,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 04:03:52,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 04:03:52,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 04:03:52,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 04:03:52,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 04:03:52,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 04:03:52,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 04:03:52,943 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:52,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 04:03:52,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 04:03:52,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 04:03:52,945 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:52,945 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:52,946 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:52,945 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:52,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39703,1676261032689, sessionid=0x1004bd96ca20000, setting cluster-up flag (Was=false) 2023-02-13 04:03:52,951 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:52,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 04:03:52,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39703,1676261032689 2023-02-13 04:03:52,959 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:52,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 04:03:52,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39703,1676261032689 2023-02-13 04:03:52,964 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.hbase-snapshot/.tmp 2023-02-13 04:03:52,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:52,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:52,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:52,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:52,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:52,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 04:03:52,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:52,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:52,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:52,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676261062969 2023-02-13 04:03:52,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 04:03:52,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 04:03:52,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 04:03:52,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 04:03:52,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 04:03:52,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 04:03:52,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:52,972 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:52,972 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 04:03:52,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 04:03:52,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 04:03:52,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 04:03:52,973 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:52,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 04:03:52,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 04:03:52,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261032976,5,FailOnTimeoutGroup] 2023-02-13 04:03:52,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261032980,5,FailOnTimeoutGroup] 2023-02-13 04:03:52,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:52,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 04:03:52,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:52,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:52,999 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:53,000 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:53,000 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7 2023-02-13 04:03:53,010 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:53,011 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:03:53,012 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/info 2023-02-13 04:03:53,012 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:03:53,013 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:53,013 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:03:53,014 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:53,014 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:03:53,015 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:53,015 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:03:53,016 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/table 2023-02-13 04:03:53,016 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:03:53,017 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:53,017 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740 2023-02-13 04:03:53,017 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740 2023-02-13 04:03:53,019 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:03:53,020 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:03:53,022 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:53,022 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75090338, jitterRate=0.11893323063850403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:03:53,022 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676261033010Initializing all the Stores at 1676261033010Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261033011 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261033011Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261033011Cleaning up temporary data from old regions at 1676261033018 (+7 ms)Cleaning up detritus from prior splits at 1676261033019 (+1 ms)Region opened successfully at 1676261033022 (+3 ms) 2023-02-13 04:03:53,022 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:03:53,022 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:03:53,022 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:03:53,022 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:03:53,022 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:03:53,023 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:03:53,023 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261033022Disabling compacts and flushes for region at 1676261033022Disabling writes for close at 1676261033022Writing region close event to WAL at 1676261033023 (+1 ms)Closed at 1676261033023 2023-02-13 04:03:53,023 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:53,023 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 04:03:53,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 04:03:53,026 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 04:03:53,026 INFO [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(952): ClusterId : 0316e2fd-8eb6-4d1c-8d83-8adadb3ad6d9 2023-02-13 04:03:53,026 DEBUG [RS:1;jenkins-hbase4:33279] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:03:53,027 INFO [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(952): ClusterId : 0316e2fd-8eb6-4d1c-8d83-8adadb3ad6d9 2023-02-13 04:03:53,027 DEBUG [RS:0;jenkins-hbase4:42471] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:03:53,028 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 04:03:53,029 DEBUG [RS:1;jenkins-hbase4:33279] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:03:53,030 DEBUG [RS:1;jenkins-hbase4:33279] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:03:53,030 DEBUG [RS:0;jenkins-hbase4:42471] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:03:53,030 DEBUG [RS:0;jenkins-hbase4:42471] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:03:53,034 DEBUG [RS:1;jenkins-hbase4:33279] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:03:53,036 DEBUG [RS:0;jenkins-hbase4:42471] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:03:53,036 DEBUG [RS:1;jenkins-hbase4:33279] zookeeper.ReadOnlyZKClient(139): Connect 0x6ab07c8a to 127.0.0.1:62833 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:53,036 DEBUG [RS:0;jenkins-hbase4:42471] zookeeper.ReadOnlyZKClient(139): Connect 0x0b69a95f to 127.0.0.1:62833 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:53,048 DEBUG [RS:1;jenkins-hbase4:33279] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64779fac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:53,048 DEBUG [RS:1;jenkins-hbase4:33279] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@604817fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:53,048 DEBUG [RS:0;jenkins-hbase4:42471] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ae5642, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:53,049 DEBUG [RS:0;jenkins-hbase4:42471] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@191c22f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:53,057 DEBUG [RS:1;jenkins-hbase4:33279] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33279 2023-02-13 04:03:53,057 DEBUG [RS:0;jenkins-hbase4:42471] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42471 2023-02-13 04:03:53,057 INFO [RS:1;jenkins-hbase4:33279] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:03:53,057 INFO [RS:1;jenkins-hbase4:33279] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:03:53,057 INFO [RS:0;jenkins-hbase4:42471] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:03:53,057 INFO [RS:0;jenkins-hbase4:42471] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:03:53,057 DEBUG [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:03:53,057 DEBUG [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:03:53,058 INFO [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39703,1676261032689 with isa=jenkins-hbase4.apache.org/172.31.14.131:33279, startcode=1676261032768 2023-02-13 04:03:53,058 INFO [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39703,1676261032689 with isa=jenkins-hbase4.apache.org/172.31.14.131:42471, startcode=1676261032736 2023-02-13 04:03:53,058 DEBUG [RS:1;jenkins-hbase4:33279] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:03:53,058 DEBUG [RS:0;jenkins-hbase4:42471] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:03:53,061 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57817, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:03:53,061 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36409, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:03:53,062 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39703] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:53,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:53,063 DEBUG [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7 2023-02-13 04:03:53,063 DEBUG [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7 2023-02-13 04:03:53,063 DEBUG [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42061 2023-02-13 04:03:53,063 DEBUG [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42061 2023-02-13 04:03:53,063 DEBUG [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:03:53,063 DEBUG [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:03:53,068 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:53,068 DEBUG [RS:1;jenkins-hbase4:33279] zookeeper.ZKUtil(162): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:53,068 DEBUG [RS:0;jenkins-hbase4:42471] zookeeper.ZKUtil(162): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:53,068 WARN [RS:1;jenkins-hbase4:33279] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:53,068 WARN [RS:0;jenkins-hbase4:42471] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:53,068 INFO [RS:1;jenkins-hbase4:33279] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:53,068 INFO [RS:0;jenkins-hbase4:42471] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:53,069 DEBUG [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/WALs/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:53,069 DEBUG [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/WALs/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:53,069 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42471,1676261032736] 2023-02-13 04:03:53,069 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33279,1676261032768] 2023-02-13 04:03:53,075 DEBUG [RS:1;jenkins-hbase4:33279] zookeeper.ZKUtil(162): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:53,075 DEBUG [RS:0;jenkins-hbase4:42471] zookeeper.ZKUtil(162): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:53,076 DEBUG [RS:1;jenkins-hbase4:33279] zookeeper.ZKUtil(162): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:53,076 DEBUG [RS:0;jenkins-hbase4:42471] zookeeper.ZKUtil(162): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:53,076 DEBUG [RS:1;jenkins-hbase4:33279] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:03:53,076 DEBUG [RS:0;jenkins-hbase4:42471] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:03:53,077 INFO [RS:1;jenkins-hbase4:33279] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:03:53,077 INFO [RS:0;jenkins-hbase4:42471] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:03:53,078 INFO [RS:1;jenkins-hbase4:33279] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:03:53,079 INFO [RS:1;jenkins-hbase4:33279] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:03:53,079 INFO [RS:1;jenkins-hbase4:33279] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,080 INFO [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:03:53,080 INFO [RS:0;jenkins-hbase4:42471] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:03:53,081 INFO [RS:0;jenkins-hbase4:42471] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:03:53,081 INFO [RS:0;jenkins-hbase4:42471] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,081 INFO [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:03:53,081 INFO [RS:1;jenkins-hbase4:33279] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,082 DEBUG [RS:1;jenkins-hbase4:33279] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,082 DEBUG [RS:1;jenkins-hbase4:33279] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,082 DEBUG [RS:1;jenkins-hbase4:33279] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,082 DEBUG [RS:1;jenkins-hbase4:33279] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,082 DEBUG [RS:1;jenkins-hbase4:33279] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,082 DEBUG [RS:1;jenkins-hbase4:33279] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:53,082 DEBUG [RS:1;jenkins-hbase4:33279] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,082 DEBUG [RS:1;jenkins-hbase4:33279] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,082 DEBUG [RS:1;jenkins-hbase4:33279] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,082 DEBUG [RS:1;jenkins-hbase4:33279] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,082 INFO [RS:0;jenkins-hbase4:42471] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,082 DEBUG [RS:0;jenkins-hbase4:42471] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,082 DEBUG [RS:0;jenkins-hbase4:42471] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,083 DEBUG [RS:0;jenkins-hbase4:42471] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,083 DEBUG [RS:0;jenkins-hbase4:42471] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,083 INFO [RS:1;jenkins-hbase4:33279] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,083 DEBUG [RS:0;jenkins-hbase4:42471] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,083 INFO [RS:1;jenkins-hbase4:33279] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,083 DEBUG [RS:0;jenkins-hbase4:42471] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:53,083 INFO [RS:1;jenkins-hbase4:33279] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,083 DEBUG [RS:0;jenkins-hbase4:42471] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,083 DEBUG [RS:0;jenkins-hbase4:42471] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,083 DEBUG [RS:0;jenkins-hbase4:42471] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,083 DEBUG [RS:0;jenkins-hbase4:42471] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:53,088 INFO [RS:0;jenkins-hbase4:42471] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,088 INFO [RS:0;jenkins-hbase4:42471] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,088 INFO [RS:0;jenkins-hbase4:42471] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,097 INFO [RS:1;jenkins-hbase4:33279] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:03:53,097 INFO [RS:1;jenkins-hbase4:33279] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33279,1676261032768-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,099 INFO [RS:0;jenkins-hbase4:42471] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:03:53,099 INFO [RS:0;jenkins-hbase4:42471] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42471,1676261032736-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,108 INFO [RS:1;jenkins-hbase4:33279] regionserver.Replication(203): jenkins-hbase4.apache.org,33279,1676261032768 started 2023-02-13 04:03:53,108 INFO [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33279,1676261032768, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33279, sessionid=0x1004bd96ca20002 2023-02-13 04:03:53,108 DEBUG [RS:1;jenkins-hbase4:33279] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:03:53,108 DEBUG [RS:1;jenkins-hbase4:33279] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:53,108 DEBUG [RS:1;jenkins-hbase4:33279] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33279,1676261032768' 2023-02-13 04:03:53,108 DEBUG [RS:1;jenkins-hbase4:33279] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:53,109 DEBUG [RS:1;jenkins-hbase4:33279] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:53,109 DEBUG [RS:1;jenkins-hbase4:33279] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:03:53,109 INFO [RS:0;jenkins-hbase4:42471] regionserver.Replication(203): jenkins-hbase4.apache.org,42471,1676261032736 started 2023-02-13 04:03:53,109 DEBUG [RS:1;jenkins-hbase4:33279] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:03:53,109 DEBUG [RS:1;jenkins-hbase4:33279] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:53,109 DEBUG [RS:1;jenkins-hbase4:33279] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33279,1676261032768' 2023-02-13 04:03:53,109 DEBUG [RS:1;jenkins-hbase4:33279] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:53,109 INFO [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42471,1676261032736, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42471, sessionid=0x1004bd96ca20001 2023-02-13 04:03:53,109 DEBUG [RS:0;jenkins-hbase4:42471] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:03:53,109 DEBUG [RS:0;jenkins-hbase4:42471] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:53,109 DEBUG [RS:0;jenkins-hbase4:42471] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42471,1676261032736' 2023-02-13 04:03:53,109 DEBUG [RS:0;jenkins-hbase4:42471] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:53,110 DEBUG [RS:1;jenkins-hbase4:33279] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:53,110 DEBUG [RS:0;jenkins-hbase4:42471] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:53,110 DEBUG [RS:1;jenkins-hbase4:33279] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:03:53,110 INFO [RS:1;jenkins-hbase4:33279] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:03:53,110 INFO [RS:1;jenkins-hbase4:33279] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:03:53,110 DEBUG [RS:0;jenkins-hbase4:42471] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:03:53,110 DEBUG [RS:0;jenkins-hbase4:42471] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:03:53,110 DEBUG [RS:0;jenkins-hbase4:42471] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:53,110 DEBUG [RS:0;jenkins-hbase4:42471] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42471,1676261032736' 2023-02-13 04:03:53,110 DEBUG [RS:0;jenkins-hbase4:42471] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:53,110 DEBUG [RS:0;jenkins-hbase4:42471] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:53,111 DEBUG [RS:0;jenkins-hbase4:42471] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:03:53,111 INFO [RS:0;jenkins-hbase4:42471] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:03:53,111 INFO [RS:0;jenkins-hbase4:42471] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:03:53,178 DEBUG [jenkins-hbase4:39703] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 04:03:53,178 DEBUG [jenkins-hbase4:39703] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:53,180 DEBUG [jenkins-hbase4:39703] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:53,180 DEBUG [jenkins-hbase4:39703] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:53,180 DEBUG [jenkins-hbase4:39703] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:53,181 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42471,1676261032736, state=OPENING 2023-02-13 04:03:53,182 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 04:03:53,183 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:53,184 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:03:53,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42471,1676261032736}] 2023-02-13 04:03:53,337 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:53,338 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:03:53,340 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51348, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:03:53,344 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 04:03:53,344 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:53,346 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42471%2C1676261032736.meta, suffix=.meta, logDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/WALs/jenkins-hbase4.apache.org,42471,1676261032736, archiveDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/oldWALs, maxLogs=32 2023-02-13 04:03:53,362 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36783,DS-c1941585-abbd-49c5-b062-559abebaee9d,DISK] 2023-02-13 04:03:53,362 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34097,DS-79aa42c4-ca62-446b-b62b-1609b7e861ca,DISK] 2023-02-13 04:03:53,364 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/WALs/jenkins-hbase4.apache.org,42471,1676261032736/jenkins-hbase4.apache.org%2C42471%2C1676261032736.meta.1676261033347.meta 2023-02-13 04:03:53,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34097,DS-79aa42c4-ca62-446b-b62b-1609b7e861ca,DISK], DatanodeInfoWithStorage[127.0.0.1:36783,DS-c1941585-abbd-49c5-b062-559abebaee9d,DISK]] 2023-02-13 04:03:53,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:53,364 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 04:03:53,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 04:03:53,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 04:03:53,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 04:03:53,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:53,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 04:03:53,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 04:03:53,367 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:03:53,369 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/info 2023-02-13 04:03:53,369 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/info 2023-02-13 04:03:53,369 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:03:53,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:53,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:03:53,370 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:53,370 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:53,371 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:03:53,371 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:53,371 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:03:53,372 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/table 2023-02-13 04:03:53,372 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/table 2023-02-13 04:03:53,372 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:03:53,372 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:53,373 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740 2023-02-13 04:03:53,374 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740 2023-02-13 04:03:53,376 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:03:53,377 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:03:53,377 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74812738, jitterRate=0.11479666829109192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:03:53,378 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676261033365Writing region info on filesystem at 1676261033365Initializing all the Stores at 1676261033366 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261033366Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261033367 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261033367Cleaning up temporary data from old regions at 1676261033375 (+8 ms)Cleaning up detritus from prior splits at 1676261033375Running coprocessor post-open hooks at 1676261033378 (+3 ms)Region opened successfully at 1676261033378 2023-02-13 04:03:53,378 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676261033337 2023-02-13 04:03:53,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 04:03:53,382 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 04:03:53,383 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42471,1676261032736, state=OPEN 2023-02-13 04:03:53,384 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 04:03:53,384 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:03:53,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 04:03:53,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42471,1676261032736 in 200 msec 2023-02-13 04:03:53,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 04:03:53,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-13 04:03:53,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 424 msec 2023-02-13 04:03:53,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676261032831, completionTime=-1 2023-02-13 04:03:53,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 04:03:53,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 04:03:53,393 DEBUG [hconnection-0x1d605a72-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:53,395 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38552, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:53,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 04:03:53,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676261093397 2023-02-13 04:03:53,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676261153397 2023-02-13 04:03:53,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-13 04:03:53,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39703,1676261032689-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39703,1676261032689-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39703,1676261032689-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39703, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:53,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 04:03:53,405 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:53,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 04:03:53,407 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 04:03:53,408 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:03:53,408 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:03:53,410 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:53,410 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb empty. 2023-02-13 04:03:53,411 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:53,411 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 04:03:53,424 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:53,426 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ed161f4e7d772e8a4026a4e89b2c75eb, NAME => 'hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp 2023-02-13 04:03:53,432 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:53,432 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ed161f4e7d772e8a4026a4e89b2c75eb, disabling compactions & flushes 2023-02-13 04:03:53,432 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:53,432 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:53,432 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. after waiting 0 ms 2023-02-13 04:03:53,432 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:53,432 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:53,432 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ed161f4e7d772e8a4026a4e89b2c75eb: Waiting for close lock at 1676261033432Disabling compacts and flushes for region at 1676261033432Disabling writes for close at 1676261033432Writing region close event to WAL at 1676261033432Closed at 1676261033432 2023-02-13 04:03:53,434 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:03:53,435 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261033435"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261033435"}]},"ts":"1676261033435"} 2023-02-13 04:03:53,437 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:03:53,438 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:03:53,438 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261033438"}]},"ts":"1676261033438"} 2023-02-13 04:03:53,439 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 04:03:53,442 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:53,442 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:53,442 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:53,442 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:53,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ed161f4e7d772e8a4026a4e89b2c75eb, ASSIGN}] 2023-02-13 04:03:53,445 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ed161f4e7d772e8a4026a4e89b2c75eb, ASSIGN 2023-02-13 04:03:53,446 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ed161f4e7d772e8a4026a4e89b2c75eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42471,1676261032736; forceNewPlan=false, retain=false 2023-02-13 04:03:53,596 INFO [jenkins-hbase4:39703] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:03:53,597 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ed161f4e7d772e8a4026a4e89b2c75eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:53,597 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261033597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261033597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261033597"}]},"ts":"1676261033597"} 2023-02-13 04:03:53,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ed161f4e7d772e8a4026a4e89b2c75eb, server=jenkins-hbase4.apache.org,42471,1676261032736}] 2023-02-13 04:03:53,754 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:53,756 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42471%2C1676261032736, suffix=, logDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/WALs/jenkins-hbase4.apache.org,42471,1676261032736, archiveDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/oldWALs, maxLogs=32 2023-02-13 04:03:53,773 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36783,DS-c1941585-abbd-49c5-b062-559abebaee9d,DISK] 2023-02-13 04:03:53,773 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34097,DS-79aa42c4-ca62-446b-b62b-1609b7e861ca,DISK] 2023-02-13 04:03:53,774 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/WALs/jenkins-hbase4.apache.org,42471,1676261032736/jenkins-hbase4.apache.org%2C42471%2C1676261032736.1676261033756 2023-02-13 04:03:53,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36783,DS-c1941585-abbd-49c5-b062-559abebaee9d,DISK], DatanodeInfoWithStorage[127.0.0.1:34097,DS-79aa42c4-ca62-446b-b62b-1609b7e861ca,DISK]] 2023-02-13 04:03:53,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ed161f4e7d772e8a4026a4e89b2c75eb, NAME => 'hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:53,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:53,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:53,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:53,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:53,778 INFO [StoreOpener-ed161f4e7d772e8a4026a4e89b2c75eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:53,779 DEBUG [StoreOpener-ed161f4e7d772e8a4026a4e89b2c75eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb/info 2023-02-13 04:03:53,779 DEBUG [StoreOpener-ed161f4e7d772e8a4026a4e89b2c75eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb/info 2023-02-13 04:03:53,780 INFO [StoreOpener-ed161f4e7d772e8a4026a4e89b2c75eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed161f4e7d772e8a4026a4e89b2c75eb columnFamilyName info 2023-02-13 04:03:53,780 INFO [StoreOpener-ed161f4e7d772e8a4026a4e89b2c75eb-1] regionserver.HStore(310): Store=ed161f4e7d772e8a4026a4e89b2c75eb/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:53,781 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:53,782 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:53,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:53,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:53,786 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ed161f4e7d772e8a4026a4e89b2c75eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68683440, jitterRate=0.023463010787963867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:03:53,786 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ed161f4e7d772e8a4026a4e89b2c75eb: Running coprocessor pre-open hook at 1676261033777Writing region info on filesystem at 1676261033777Initializing all the Stores at 1676261033778 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261033778Cleaning up temporary data from old regions at 1676261033782 (+4 ms)Cleaning up detritus from prior splits at 1676261033783 (+1 ms)Running coprocessor post-open hooks at 1676261033786 (+3 ms)Region opened successfully at 1676261033786 2023-02-13 04:03:53,787 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb., pid=6, masterSystemTime=1676261033751 2023-02-13 04:03:53,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:53,789 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:53,789 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ed161f4e7d772e8a4026a4e89b2c75eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:53,789 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261033789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261033789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261033789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261033789"}]},"ts":"1676261033789"} 2023-02-13 04:03:53,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 04:03:53,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ed161f4e7d772e8a4026a4e89b2c75eb, server=jenkins-hbase4.apache.org,42471,1676261032736 in 192 msec 2023-02-13 04:03:53,794 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 04:03:53,794 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ed161f4e7d772e8a4026a4e89b2c75eb, ASSIGN in 350 msec 2023-02-13 04:03:53,795 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:03:53,795 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261033795"}]},"ts":"1676261033795"} 2023-02-13 04:03:53,796 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 04:03:53,800 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:03:53,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 394 msec 2023-02-13 04:03:53,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 04:03:53,808 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:53,808 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:53,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 04:03:53,820 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:53,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-13 04:03:53,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 04:03:53,841 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:53,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-13 04:03:53,848 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 04:03:53,850 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 04:03:53,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.014sec 2023-02-13 04:03:53,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 04:03:53,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 04:03:53,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 04:03:53,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39703,1676261032689-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 04:03:53,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39703,1676261032689-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 04:03:53,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 04:03:53,926 DEBUG [Listener at localhost/37903] zookeeper.ReadOnlyZKClient(139): Connect 0x10a0070e to 127.0.0.1:62833 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:53,933 DEBUG [Listener at localhost/37903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f4fc1ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:53,934 DEBUG [hconnection-0x3f3ec1c9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:53,936 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38556, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:53,938 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39703,1676261032689 2023-02-13 04:03:53,938 DEBUG [Listener at localhost/37903] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 04:03:53,940 DEBUG [Listener at localhost/37903] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:03:53,943 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:03:53,943 INFO [Listener at localhost/37903] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:53,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:53,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 04:03:53,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:57640 deadline: 1676261093944, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:53,945 INFO [Listener at localhost/37903] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-13 04:03:53,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:53,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:53,950 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:03:53,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-13 04:03:53,951 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:03:53,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:53,953 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:53,954 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32 empty. 2023-02-13 04:03:53,954 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:53,954 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-13 04:03:53,971 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:53,973 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => f7b8e8d38f670cc9a2b82a0b94535f32, NAME => 'testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp 2023-02-13 04:03:53,980 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:53,980 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing f7b8e8d38f670cc9a2b82a0b94535f32, disabling compactions & flushes 2023-02-13 04:03:53,980 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:53,981 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:53,981 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. after waiting 0 ms 2023-02-13 04:03:53,981 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:53,981 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:53,981 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for f7b8e8d38f670cc9a2b82a0b94535f32: Waiting for close lock at 1676261033980Disabling compacts and flushes for region at 1676261033980Disabling writes for close at 1676261033981 (+1 ms)Writing region close event to WAL at 1676261033981Closed at 1676261033981 2023-02-13 04:03:53,982 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:03:53,983 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676261033983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261033983"}]},"ts":"1676261033983"} 2023-02-13 04:03:53,985 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:03:53,986 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:03:53,986 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261033986"}]},"ts":"1676261033986"} 2023-02-13 04:03:53,987 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-13 04:03:53,991 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:53,992 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:53,992 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:53,992 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:53,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f7b8e8d38f670cc9a2b82a0b94535f32, ASSIGN}] 2023-02-13 04:03:53,994 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f7b8e8d38f670cc9a2b82a0b94535f32, ASSIGN 2023-02-13 04:03:53,994 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f7b8e8d38f670cc9a2b82a0b94535f32, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42471,1676261032736; forceNewPlan=false, retain=false 2023-02-13 04:03:54,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:54,112 INFO [RS:1;jenkins-hbase4:33279] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33279%2C1676261032768, suffix=, logDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/WALs/jenkins-hbase4.apache.org,33279,1676261032768, archiveDir=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/oldWALs, maxLogs=32 2023-02-13 04:03:54,128 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34097,DS-79aa42c4-ca62-446b-b62b-1609b7e861ca,DISK] 2023-02-13 04:03:54,128 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36783,DS-c1941585-abbd-49c5-b062-559abebaee9d,DISK] 2023-02-13 04:03:54,130 INFO [RS:1;jenkins-hbase4:33279] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/WALs/jenkins-hbase4.apache.org,33279,1676261032768/jenkins-hbase4.apache.org%2C33279%2C1676261032768.1676261034113 2023-02-13 04:03:54,130 DEBUG [RS:1;jenkins-hbase4:33279] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36783,DS-c1941585-abbd-49c5-b062-559abebaee9d,DISK], DatanodeInfoWithStorage[127.0.0.1:34097,DS-79aa42c4-ca62-446b-b62b-1609b7e861ca,DISK]] 2023-02-13 04:03:54,144 INFO [jenkins-hbase4:39703] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:03:54,145 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f7b8e8d38f670cc9a2b82a0b94535f32, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,145 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676261034145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261034145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261034145"}]},"ts":"1676261034145"} 2023-02-13 04:03:54,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure f7b8e8d38f670cc9a2b82a0b94535f32, server=jenkins-hbase4.apache.org,42471,1676261032736}] 2023-02-13 04:03:54,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:54,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:54,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f7b8e8d38f670cc9a2b82a0b94535f32, NAME => 'testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:54,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:54,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:54,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:54,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:54,304 INFO [StoreOpener-f7b8e8d38f670cc9a2b82a0b94535f32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:54,306 DEBUG [StoreOpener-f7b8e8d38f670cc9a2b82a0b94535f32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1 2023-02-13 04:03:54,306 DEBUG [StoreOpener-f7b8e8d38f670cc9a2b82a0b94535f32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1 2023-02-13 04:03:54,306 INFO [StoreOpener-f7b8e8d38f670cc9a2b82a0b94535f32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7b8e8d38f670cc9a2b82a0b94535f32 columnFamilyName f1 2023-02-13 04:03:54,306 INFO [StoreOpener-f7b8e8d38f670cc9a2b82a0b94535f32-1] regionserver.HStore(310): Store=f7b8e8d38f670cc9a2b82a0b94535f32/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:54,307 INFO [StoreOpener-f7b8e8d38f670cc9a2b82a0b94535f32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:54,308 DEBUG [StoreOpener-f7b8e8d38f670cc9a2b82a0b94535f32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2 2023-02-13 04:03:54,308 DEBUG [StoreOpener-f7b8e8d38f670cc9a2b82a0b94535f32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2 2023-02-13 04:03:54,308 INFO [StoreOpener-f7b8e8d38f670cc9a2b82a0b94535f32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7b8e8d38f670cc9a2b82a0b94535f32 columnFamilyName f2 2023-02-13 04:03:54,308 INFO [StoreOpener-f7b8e8d38f670cc9a2b82a0b94535f32-1] regionserver.HStore(310): Store=f7b8e8d38f670cc9a2b82a0b94535f32/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:54,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:54,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:54,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:54,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:54,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:54,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f7b8e8d38f670cc9a2b82a0b94535f32; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63010859, jitterRate=-0.061065033078193665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:54,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f7b8e8d38f670cc9a2b82a0b94535f32: Running coprocessor pre-open hook at 1676261034303Writing region info on filesystem at 1676261034303Initializing all the Stores at 1676261034304 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261034304Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261034304Cleaning up temporary data from old regions at 1676261034310 (+6 ms)Cleaning up detritus from prior splits at 1676261034310Running coprocessor post-open hooks at 1676261034314 (+4 ms)Region opened successfully at 1676261034314 2023-02-13 04:03:54,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32., pid=12, masterSystemTime=1676261034299 2023-02-13 04:03:54,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:54,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:54,317 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f7b8e8d38f670cc9a2b82a0b94535f32, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,317 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676261034317"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261034317"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261034317"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261034317"}]},"ts":"1676261034317"} 2023-02-13 04:03:54,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 04:03:54,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure f7b8e8d38f670cc9a2b82a0b94535f32, server=jenkins-hbase4.apache.org,42471,1676261032736 in 172 msec 2023-02-13 04:03:54,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 04:03:54,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f7b8e8d38f670cc9a2b82a0b94535f32, ASSIGN in 328 msec 2023-02-13 04:03:54,323 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:03:54,323 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261034323"}]},"ts":"1676261034323"} 2023-02-13 04:03:54,324 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-13 04:03:54,327 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:03:54,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 380 msec 2023-02-13 04:03:54,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:54,558 INFO [Listener at localhost/37903] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-13 04:03:54,558 DEBUG [Listener at localhost/37903] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-13 04:03:54,558 INFO [Listener at localhost/37903] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:03:54,560 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-13 04:03:54,561 INFO [Listener at localhost/37903] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:03:54,561 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-13 04:03:54,561 INFO [Listener at localhost/37903] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 04:03:54,609 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42471] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:54,753 INFO [Listener at localhost/37903] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 04:03:54,753 INFO [Listener at localhost/37903] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 04:03:54,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 04:03:54,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676261034755 (current time:1676261034755). 2023-02-13 04:03:54,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 04:03:54,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] zookeeper.ReadOnlyZKClient(139): Connect 0x517a6017 to 127.0.0.1:62833 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:54,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6171742e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:54,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:54,763 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:54,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x517a6017 to 127.0.0.1:62833 2023-02-13 04:03:54,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:54,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 04:03:54,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 04:03:54,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 04:03:54,767 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 04:03:54,768 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676261634768 2023-02-13 04:03:54,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 04:03:54,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:54,769 DEBUG [Listener at localhost/37903] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 04:03:54,770 DEBUG [Listener at localhost/37903] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 04:03:54,770 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 04:03:54,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 04:03:54,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-13 04:03:54,772 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 04:03:54,772 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676261634772 2023-02-13 04:03:54,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-13 04:03:54,788 INFO [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-13 04:03:54,788 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:54,789 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-13 04:03:54,789 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-13 04:03:54,789 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,789 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-13 04:03:54,792 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:54,792 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:54,792 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:54,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:54,792 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,792 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:03:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 04:03:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 04:03:54,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-13 04:03:54,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 04:03:54,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-13 04:03:54,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-13 04:03:54,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 04:03:54,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-13 04:03:54,796 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 04:03:54,796 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 04:03:54,796 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 04:03:54,796 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:54,799 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 04:03:54,799 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 04:03:54,799 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33279,1676261032768' joining acquired barrier for procedure (foo) in zk 2023-02-13 04:03:54,799 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 04:03:54,799 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:54,800 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 04:03:54,800 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 04:03:54,800 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42471,1676261032736' joining acquired barrier for procedure (foo) in zk 2023-02-13 04:03:54,801 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,802 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,802 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:54,802 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,802 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:54,802 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,802 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:03:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:54,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42471,1676261032736' joining acquired barrier for procedure 'foo' on coordinator 2023-02-13 04:03:54,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@537f39eb[Count = 0] remaining members to acquire global barrier 2023-02-13 04:03:54,804 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-13 04:03:54,804 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,805 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,805 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,805 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 04:03:54,805 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 04:03:54,805 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 04:03:54,806 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,33279,1676261032768' in zk 2023-02-13 04:03:54,805 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,806 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:03:54,808 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 04:03:54,808 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:54,808 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 04:03:54,811 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 04:03:54,811 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:03:54,811 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:54,811 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. started... 2023-02-13 04:03:54,811 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f7b8e8d38f670cc9a2b82a0b94535f32 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 04:03:54,830 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/.tmp/f1/10e844767c9e4b4f94f1739eba9c1b89 2023-02-13 04:03:54,852 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/.tmp/f2/a734ac230de64bed862b78b7be44a388 2023-02-13 04:03:54,856 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/.tmp/f1/10e844767c9e4b4f94f1739eba9c1b89 as hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1/10e844767c9e4b4f94f1739eba9c1b89 2023-02-13 04:03:54,860 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1/10e844767c9e4b4f94f1739eba9c1b89, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 04:03:54,861 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/.tmp/f2/a734ac230de64bed862b78b7be44a388 as hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2/a734ac230de64bed862b78b7be44a388 2023-02-13 04:03:54,865 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2/a734ac230de64bed862b78b7be44a388, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 04:03:54,867 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for f7b8e8d38f670cc9a2b82a0b94535f32 in 56ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:54,867 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-13 04:03:54,868 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f7b8e8d38f670cc9a2b82a0b94535f32: 2023-02-13 04:03:54,868 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.' region-info for snapshot=foo 2023-02-13 04:03:54,868 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:54,868 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1/10e844767c9e4b4f94f1739eba9c1b89] hfiles 2023-02-13 04:03:54,868 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1/10e844767c9e4b4f94f1739eba9c1b89 for snapshot=foo 2023-02-13 04:03:54,868 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2/a734ac230de64bed862b78b7be44a388] hfiles 2023-02-13 04:03:54,868 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2/a734ac230de64bed862b78b7be44a388 for snapshot=foo 2023-02-13 04:03:54,870 DEBUG [Listener at localhost/37903] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:54,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-13 04:03:54,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:03:54,872 DEBUG [Listener at localhost/37903] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 04:03:54,878 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. completed. 2023-02-13 04:03:54,878 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:54,878 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 04:03:54,878 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 04:03:54,878 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,878 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 04:03:54,878 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,42471,1676261032736' in zk 2023-02-13 04:03:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 04:03:54,880 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 04:03:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:03:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:03:54,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:54,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,42471,1676261032736': 2023-02-13 04:03:54,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42471,1676261032736' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-13 04:03:54,884 INFO [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-13 04:03:54,884 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:03:54,884 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:03:54,884 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-13 04:03:54,884 INFO [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 04:03:54,885 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,885 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,885 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:54,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,885 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:54,885 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:54,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:54,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:54,886 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:03:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,887 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:54,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:54,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:03:54,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:54,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:54,888 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:03:54,888 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:54,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:54,894 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:54,894 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:54,894 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 04:03:54,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:54,894 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,894 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:54,895 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 04:03:54,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:54,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-13 04:03:54,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:54,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-13 04:03:54,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:54,895 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:54,895 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:54,896 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,896 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:54,896 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 04:03:54,896 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 04:03:54,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.hbase-snapshot/.tmp/foo 2023-02-13 04:03:54,895 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:54,895 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:03:54,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:54,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:03:54,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:54,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:54,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.hbase-snapshot/.tmp/foo to hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.hbase-snapshot/foo 2023-02-13 04:03:54,927 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-13 04:03:54,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.hbase-snapshot/.tmp/foo 2023-02-13 04:03:54,927 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.hbase-snapshot/.tmp/foo 2023-02-13 04:03:54,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676261034768Consolidate snapshot: foo at 1676261034895 (+127 ms)Loading Region manifests for foo at 1676261034895Writing data manifest for foo at 1676261034899 (+4 ms)Verifying snapshot: foo at 1676261034906 (+7 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676261034927 (+21 ms) 2023-02-13 04:03:54,929 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 04:03:54,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 160 msec 2023-02-13 04:03:55,072 DEBUG [Listener at localhost/37903] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:55,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-13 04:03:55,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 04:03:55,074 INFO [Listener at localhost/37903] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 04:03:55,078 INFO [Listener at localhost/37903] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 04:03:55,083 INFO [Listener at localhost/37903] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 04:03:55,119 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42471] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,231 INFO [Listener at localhost/37903] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 04:03:55,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:03:55,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,239 INFO [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-13 04:03:55,239 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:03:55,240 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-13 04:03:55,240 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-13 04:03:55,240 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,240 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,242 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:55,242 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:55,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:55,242 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:55,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:55,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:55,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,242 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,242 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:03:55,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:03:55,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,243 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:03:55,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,243 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,248 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-13 04:03:55,248 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:03:55,249 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-13 04:03:55,249 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-13 04:03:55,249 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:03:55,249 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:03:55,249 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,249 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:03:55,249 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. started... 2023-02-13 04:03:55,249 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-13 04:03:55,250 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-13 04:03:55,250 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33279,1676261032768' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-13 04:03:55,250 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f7b8e8d38f670cc9a2b82a0b94535f32 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 04:03:55,252 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,252 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,252 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:55,274 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/.tmp/f1/4018d521fcbb4a4db89bad5c529bc568 2023-02-13 04:03:55,296 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/.tmp/f2/f333094fc561480198360d8ea9e5e05f 2023-02-13 04:03:55,301 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/.tmp/f1/4018d521fcbb4a4db89bad5c529bc568 as hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1/4018d521fcbb4a4db89bad5c529bc568 2023-02-13 04:03:55,306 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1/4018d521fcbb4a4db89bad5c529bc568, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 04:03:55,307 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/.tmp/f2/f333094fc561480198360d8ea9e5e05f as hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2/f333094fc561480198360d8ea9e5e05f 2023-02-13 04:03:55,311 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2/f333094fc561480198360d8ea9e5e05f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 04:03:55,312 INFO [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for f7b8e8d38f670cc9a2b82a0b94535f32 in 62ms, sequenceid=9, compaction requested=false 2023-02-13 04:03:55,313 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f7b8e8d38f670cc9a2b82a0b94535f32: 2023-02-13 04:03:55,313 DEBUG [rs(jenkins-hbase4.apache.org,42471,1676261032736)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,313 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:03:55,313 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:03:55,313 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,313 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-13 04:03:55,313 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42471,1676261032736' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-13 04:03:55,315 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,315 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:55,315 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,315 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:55,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42471,1676261032736' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-13 04:03:55,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5740b75c[Count = 0] remaining members to acquire global barrier 2023-02-13 04:03:55,317 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-13 04:03:55,317 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,319 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,319 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,320 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-13 04:03:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-13 04:03:55,320 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:03:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,33279,1676261032768' in zk 2023-02-13 04:03:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-13 04:03:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-13 04:03:55,320 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,42471,1676261032736' in zk 2023-02-13 04:03:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-13 04:03:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-13 04:03:55,321 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,42471,1676261032736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-13 04:03:55,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:55,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,33279,1676261032768' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-13 04:03:55,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:55,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,42471,1676261032736': 2023-02-13 04:03:55,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42471,1676261032736' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-13 04:03:55,326 INFO [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-13 04:03:55,326 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:03:55,326 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:03:55,326 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,326 INFO [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:03:55,327 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,327 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,327 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:03:55,327 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,327 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:55,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:55,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:55,328 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,329 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:55,330 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,330 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,333 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:55,333 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:55,333 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:03:55,333 DEBUG [(jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:03:55,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:03:55,333 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:55,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-13 04:03:55,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:03:55,333 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,333 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:03:55,334 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:55,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:55,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:55,334 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,334 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,334 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,334 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,334 DEBUG [Listener at localhost/37903] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-13 04:03:55,334 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,334 DEBUG [Listener at localhost/37903] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:03:55,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:03:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:55,334 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,435 DEBUG [Listener at localhost/37903] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:03:55,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:03:55,440 INFO [Listener at localhost/37903] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676261034755 type: FLUSH version: 2 ttl: 0 2023-02-13 04:03:55,441 DEBUG [Listener at localhost/37903] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42061/user/jenkins/test-data/f82b856d-3c79-d04c-a76c-ac42555dc924/foo/512391c1-e084-43df-b028-e15909ee9e2a/data/default/testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,441 INFO [Listener at localhost/37903] snapshot.RestoreSnapshotHelper(239): region to add: f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:55,441 INFO [Listener at localhost/37903] snapshot.RestoreSnapshotHelper(585): clone region=f7b8e8d38f670cc9a2b82a0b94535f32 as f7b8e8d38f670cc9a2b82a0b94535f32 in snapshot foo 2023-02-13 04:03:55,442 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => f7b8e8d38f670cc9a2b82a0b94535f32, NAME => 'testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42061/user/jenkins/test-data/f82b856d-3c79-d04c-a76c-ac42555dc924/foo/512391c1-e084-43df-b028-e15909ee9e2a 2023-02-13 04:03:55,451 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:55,451 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 10e844767c9e4b4f94f1739eba9c1b89 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,455 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a734ac230de64bed862b78b7be44a388 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,457 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing f7b8e8d38f670cc9a2b82a0b94535f32, disabling compactions & flushes 2023-02-13 04:03:55,457 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,457 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,457 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. after waiting 0 ms 2023-02-13 04:03:55,457 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,457 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,457 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for f7b8e8d38f670cc9a2b82a0b94535f32: Waiting for close lock at 1676261035457Disabling compacts and flushes for region at 1676261035457Disabling writes for close at 1676261035457Writing region close event to WAL at 1676261035457Closed at 1676261035457 2023-02-13 04:03:55,457 INFO [Listener at localhost/37903] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676261034755 type: FLUSH version: 2 ttl: 0 2023-02-13 04:03:55,457 DEBUG [Listener at localhost/37903] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42061/user/jenkins/test-data/f82b856d-3c79-d04c-a76c-ac42555dc924/foo/512391c1-e084-43df-b028-e15909ee9e2a 2023-02-13 04:03:55,458 DEBUG [Listener at localhost/37903] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42061/user/jenkins/test-data/f82b856d-3c79-d04c-a76c-ac42555dc924/foo/512391c1-e084-43df-b028-e15909ee9e2a 2023-02-13 04:03:55,458 DEBUG [Listener at localhost/37903] util.CommonFSUtils(699): |-data/ 2023-02-13 04:03:55,459 DEBUG [Listener at localhost/37903] util.CommonFSUtils(699): |----default/ 2023-02-13 04:03:55,459 DEBUG [Listener at localhost/37903] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-13 04:03:55,459 DEBUG [Listener at localhost/37903] util.CommonFSUtils(699): |----------f7b8e8d38f670cc9a2b82a0b94535f32/ 2023-02-13 04:03:55,460 DEBUG [Listener at localhost/37903] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:03:55,460 DEBUG [Listener at localhost/37903] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:03:55,460 DEBUG [Listener at localhost/37903] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=f7b8e8d38f670cc9a2b82a0b94535f32-10e844767c9e4b4f94f1739eba9c1b89 2023-02-13 04:03:55,461 DEBUG [Listener at localhost/37903] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:03:55,461 DEBUG [Listener at localhost/37903] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=f7b8e8d38f670cc9a2b82a0b94535f32-a734ac230de64bed862b78b7be44a388 2023-02-13 04:03:55,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-13 04:03:55,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-13 04:03:55,466 INFO [Listener at localhost/37903] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:03:55,469 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261035469"}]},"ts":"1676261035469"} 2023-02-13 04:03:55,471 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-13 04:03:55,473 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-13 04:03:55,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f7b8e8d38f670cc9a2b82a0b94535f32, UNASSIGN}] 2023-02-13 04:03:55,475 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f7b8e8d38f670cc9a2b82a0b94535f32, UNASSIGN 2023-02-13 04:03:55,476 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f7b8e8d38f670cc9a2b82a0b94535f32, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,476 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676261035476"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261035476"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261035476"}]},"ts":"1676261035476"} 2023-02-13 04:03:55,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure f7b8e8d38f670cc9a2b82a0b94535f32, server=jenkins-hbase4.apache.org,42471,1676261032736}] 2023-02-13 04:03:55,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:03:55,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:55,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f7b8e8d38f670cc9a2b82a0b94535f32, disabling compactions & flushes 2023-02-13 04:03:55,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. after waiting 0 ms 2023-02-13 04:03:55,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:03:55,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32. 2023-02-13 04:03:55,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f7b8e8d38f670cc9a2b82a0b94535f32: Waiting for close lock at 1676261035630Running coprocessor pre-close hooks at 1676261035630Disabling compacts and flushes for region at 1676261035630Disabling writes for close at 1676261035630Writing region close event to WAL at 1676261035631 (+1 ms)Running coprocessor post-close hooks at 1676261035634 (+3 ms)Closed at 1676261035634 2023-02-13 04:03:55,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:55,636 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f7b8e8d38f670cc9a2b82a0b94535f32, regionState=CLOSED 2023-02-13 04:03:55,637 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676261035636"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261035636"}]},"ts":"1676261035636"} 2023-02-13 04:03:55,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 04:03:55,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure f7b8e8d38f670cc9a2b82a0b94535f32, server=jenkins-hbase4.apache.org,42471,1676261032736 in 161 msec 2023-02-13 04:03:55,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 04:03:55,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=f7b8e8d38f670cc9a2b82a0b94535f32, UNASSIGN in 165 msec 2023-02-13 04:03:55,641 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261035641"}]},"ts":"1676261035641"} 2023-02-13 04:03:55,645 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-13 04:03:55,647 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-13 04:03:55,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 182 msec 2023-02-13 04:03:55,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:03:55,773 INFO [Listener at localhost/37903] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-13 04:03:55,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,776 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,777 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 04:03:55,780 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:55,782 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1, FileablePath, hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2, FileablePath, hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/recovered.edits] 2023-02-13 04:03:55,785 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1/10e844767c9e4b4f94f1739eba9c1b89 to hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/archive/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1/10e844767c9e4b4f94f1739eba9c1b89 2023-02-13 04:03:55,786 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1/4018d521fcbb4a4db89bad5c529bc568 to hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/archive/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f1/4018d521fcbb4a4db89bad5c529bc568 2023-02-13 04:03:55,789 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2/a734ac230de64bed862b78b7be44a388 to hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/archive/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2/a734ac230de64bed862b78b7be44a388 2023-02-13 04:03:55,790 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2/f333094fc561480198360d8ea9e5e05f to hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/archive/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/f2/f333094fc561480198360d8ea9e5e05f 2023-02-13 04:03:55,793 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/recovered.edits/12.seqid to hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/archive/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32/recovered.edits/12.seqid 2023-02-13 04:03:55,793 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/.tmp/data/default/testInitTableSnapshotMapperJobConfig/f7b8e8d38f670cc9a2b82a0b94535f32 2023-02-13 04:03:55,794 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-13 04:03:55,796 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,798 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-13 04:03:55,800 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-13 04:03:55,801 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,801 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-13 04:03:55,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261035801"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:55,802 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 04:03:55,802 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f7b8e8d38f670cc9a2b82a0b94535f32, NAME => 'testInitTableSnapshotMapperJobConfig,,1676261033947.f7b8e8d38f670cc9a2b82a0b94535f32.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 04:03:55,802 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-13 04:03:55,802 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676261035802"}]},"ts":"9223372036854775807"} 2023-02-13 04:03:55,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-13 04:03:55,807 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 04:03:55,808 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 33 msec 2023-02-13 04:03:55,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39703] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 04:03:55,879 INFO [Listener at localhost/37903] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-13 04:03:55,879 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 04:03:55,879 INFO [Listener at localhost/37903] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:03:55,880 DEBUG [Listener at localhost/37903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10a0070e to 127.0.0.1:62833 2023-02-13 04:03:55,880 DEBUG [Listener at localhost/37903] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:55,880 DEBUG [Listener at localhost/37903] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 04:03:55,880 DEBUG [Listener at localhost/37903] util.JVMClusterUtil(257): Found active master hash=1261568379, stopped=false 2023-02-13 04:03:55,880 INFO [Listener at localhost/37903] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39703,1676261032689 2023-02-13 04:03:55,883 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:55,883 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:55,883 INFO [Listener at localhost/37903] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 04:03:55,883 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:55,883 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:55,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:55,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:55,884 DEBUG [Listener at localhost/37903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34d2ef00 to 127.0.0.1:62833 2023-02-13 04:03:55,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:55,885 DEBUG [Listener at localhost/37903] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:55,885 INFO [Listener at localhost/37903] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42471,1676261032736' ***** 2023-02-13 04:03:55,885 INFO [Listener at localhost/37903] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:03:55,885 INFO [Listener at localhost/37903] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33279,1676261032768' ***** 2023-02-13 04:03:55,885 INFO [Listener at localhost/37903] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:03:55,885 INFO [RS:0;jenkins-hbase4:42471] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:03:55,885 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:03:55,885 INFO [RS:0;jenkins-hbase4:42471] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:03:55,885 INFO [RS:1;jenkins-hbase4:33279] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:03:55,886 INFO [RS:0;jenkins-hbase4:42471] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:03:55,886 INFO [RS:1;jenkins-hbase4:33279] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:03:55,886 INFO [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(3304): Received CLOSE for ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:55,886 INFO [RS:1;jenkins-hbase4:33279] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:03:55,887 INFO [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:55,887 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:03:55,887 DEBUG [RS:0;jenkins-hbase4:42471] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b69a95f to 127.0.0.1:62833 2023-02-13 04:03:55,887 INFO [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,889 DEBUG [RS:0;jenkins-hbase4:42471] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:55,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ed161f4e7d772e8a4026a4e89b2c75eb, disabling compactions & flushes 2023-02-13 04:03:55,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:55,889 INFO [RS:0;jenkins-hbase4:42471] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:03:55,889 INFO [RS:0;jenkins-hbase4:42471] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:03:55,889 INFO [RS:0;jenkins-hbase4:42471] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:03:55,889 DEBUG [RS:1;jenkins-hbase4:33279] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ab07c8a to 127.0.0.1:62833 2023-02-13 04:03:55,889 INFO [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 04:03:55,889 DEBUG [RS:1;jenkins-hbase4:33279] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:55,889 INFO [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33279,1676261032768; all regions closed. 2023-02-13 04:03:55,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:55,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. after waiting 0 ms 2023-02-13 04:03:55,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:55,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing ed161f4e7d772e8a4026a4e89b2c75eb 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 04:03:55,890 INFO [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 04:03:55,890 DEBUG [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1479): Online Regions={ed161f4e7d772e8a4026a4e89b2c75eb=hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb., 1588230740=hbase:meta,,1.1588230740} 2023-02-13 04:03:55,890 DEBUG [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1505): Waiting on 1588230740, ed161f4e7d772e8a4026a4e89b2c75eb 2023-02-13 04:03:55,891 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:03:55,891 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:03:55,891 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:03:55,891 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:03:55,891 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:03:55,891 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:55,891 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-13 04:03:55,897 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:55,900 DEBUG [RS:1;jenkins-hbase4:33279] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/oldWALs 2023-02-13 04:03:55,900 INFO [RS:1;jenkins-hbase4:33279] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33279%2C1676261032768:(num 1676261034113) 2023-02-13 04:03:55,900 DEBUG [RS:1;jenkins-hbase4:33279] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:55,900 INFO [RS:1;jenkins-hbase4:33279] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:55,901 INFO [RS:1;jenkins-hbase4:33279] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 04:03:55,901 INFO [RS:1;jenkins-hbase4:33279] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:03:55,901 INFO [RS:1;jenkins-hbase4:33279] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:03:55,901 INFO [RS:1;jenkins-hbase4:33279] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:03:55,901 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:03:55,902 INFO [RS:1;jenkins-hbase4:33279] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33279 2023-02-13 04:03:55,905 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,905 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33279,1676261032768 2023-02-13 04:03:55,905 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:55,905 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:55,905 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:55,912 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33279,1676261032768] 2023-02-13 04:03:55,912 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33279,1676261032768; numProcessing=1 2023-02-13 04:03:55,914 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33279,1676261032768 already deleted, retry=false 2023-02-13 04:03:55,914 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33279,1676261032768 expired; onlineServers=1 2023-02-13 04:03:55,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb/.tmp/info/a17d058dc24b4d2ca87833da7c2ce2b9 2023-02-13 04:03:55,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/.tmp/info/d29a4520669b4c2b84088a1a371c9621 2023-02-13 04:03:55,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb/.tmp/info/a17d058dc24b4d2ca87833da7c2ce2b9 as hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb/info/a17d058dc24b4d2ca87833da7c2ce2b9 2023-02-13 04:03:55,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d29a4520669b4c2b84088a1a371c9621 2023-02-13 04:03:55,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb/info/a17d058dc24b4d2ca87833da7c2ce2b9, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 04:03:55,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ed161f4e7d772e8a4026a4e89b2c75eb in 40ms, sequenceid=6, compaction requested=false 2023-02-13 04:03:55,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/namespace/ed161f4e7d772e8a4026a4e89b2c75eb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 04:03:55,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:55,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ed161f4e7d772e8a4026a4e89b2c75eb: Waiting for close lock at 1676261035888Running coprocessor pre-close hooks at 1676261035888Disabling compacts and flushes for region at 1676261035888Disabling writes for close at 1676261035889 (+1 ms)Obtaining lock to block concurrent updates at 1676261035889Preparing flush snapshotting stores in ed161f4e7d772e8a4026a4e89b2c75eb at 1676261035889Finished memstore snapshotting hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676261035890 (+1 ms)Flushing stores of hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. at 1676261035890Flushing ed161f4e7d772e8a4026a4e89b2c75eb/info: creating writer at 1676261035890Flushing ed161f4e7d772e8a4026a4e89b2c75eb/info: appending metadata at 1676261035899 (+9 ms)Flushing ed161f4e7d772e8a4026a4e89b2c75eb/info: closing flushed file at 1676261035899Flushing ed161f4e7d772e8a4026a4e89b2c75eb/info: reopening flushed file at 1676261035925 (+26 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ed161f4e7d772e8a4026a4e89b2c75eb in 40ms, sequenceid=6, compaction requested=false at 1676261035929 (+4 ms)Writing region close event to WAL at 1676261035930 (+1 ms)Running coprocessor post-close hooks at 1676261035933 (+3 ms)Closed at 1676261035933 2023-02-13 04:03:55,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676261033405.ed161f4e7d772e8a4026a4e89b2c75eb. 2023-02-13 04:03:55,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/.tmp/rep_barrier/bd80ebce5158424d950a2cfb9c23f2f2 2023-02-13 04:03:55,940 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd80ebce5158424d950a2cfb9c23f2f2 2023-02-13 04:03:55,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/.tmp/table/b136799e35ee497c941c8eebeff829ed 2023-02-13 04:03:55,951 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b136799e35ee497c941c8eebeff829ed 2023-02-13 04:03:55,952 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/.tmp/info/d29a4520669b4c2b84088a1a371c9621 as hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/info/d29a4520669b4c2b84088a1a371c9621 2023-02-13 04:03:55,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d29a4520669b4c2b84088a1a371c9621 2023-02-13 04:03:55,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/info/d29a4520669b4c2b84088a1a371c9621, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 04:03:55,957 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/.tmp/rep_barrier/bd80ebce5158424d950a2cfb9c23f2f2 as hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/rep_barrier/bd80ebce5158424d950a2cfb9c23f2f2 2023-02-13 04:03:55,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd80ebce5158424d950a2cfb9c23f2f2 2023-02-13 04:03:55,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/rep_barrier/bd80ebce5158424d950a2cfb9c23f2f2, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 04:03:55,961 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/.tmp/table/b136799e35ee497c941c8eebeff829ed as hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/table/b136799e35ee497c941c8eebeff829ed 2023-02-13 04:03:55,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b136799e35ee497c941c8eebeff829ed 2023-02-13 04:03:55,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/table/b136799e35ee497c941c8eebeff829ed, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 04:03:55,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 78ms, sequenceid=21, compaction requested=false 2023-02-13 04:03:55,975 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 04:03:55,975 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 04:03:55,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:03:55,975 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261035890Running coprocessor pre-close hooks at 1676261035890Disabling compacts and flushes for region at 1676261035890Disabling writes for close at 1676261035891 (+1 ms)Obtaining lock to block concurrent updates at 1676261035892 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676261035892Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676261035892Flushing stores of hbase:meta,,1.1588230740 at 1676261035893 (+1 ms)Flushing 1588230740/info: creating writer at 1676261035893Flushing 1588230740/info: appending metadata at 1676261035900 (+7 ms)Flushing 1588230740/info: closing flushed file at 1676261035900Flushing 1588230740/rep_barrier: creating writer at 1676261035926 (+26 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676261035929 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676261035929Flushing 1588230740/table: creating writer at 1676261035940 (+11 ms)Flushing 1588230740/table: appending metadata at 1676261035942 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676261035942Flushing 1588230740/info: reopening flushed file at 1676261035952 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676261035957 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676261035962 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 78ms, sequenceid=21, compaction requested=false at 1676261035969 (+7 ms)Writing region close event to WAL at 1676261035972 (+3 ms)Running coprocessor post-close hooks at 1676261035975 (+3 ms)Closed at 1676261035975 2023-02-13 04:03:55,975 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 04:03:56,082 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:56,082 INFO [RS:1;jenkins-hbase4:33279] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33279,1676261032768; zookeeper connection closed. 2023-02-13 04:03:56,082 ERROR [Listener at localhost/37903-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@20348505 rejected from java.util.concurrent.ThreadPoolExecutor@240b05db[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:56,084 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1ed911ef] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1ed911ef 2023-02-13 04:03:56,084 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:33279-0x1004bd96ca20002, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:56,084 ERROR [Listener at localhost/37903-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@54ba3382 rejected from java.util.concurrent.ThreadPoolExecutor@240b05db[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:56,090 INFO [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42471,1676261032736; all regions closed. 2023-02-13 04:03:56,096 DEBUG [RS:0;jenkins-hbase4:42471] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/oldWALs 2023-02-13 04:03:56,096 INFO [RS:0;jenkins-hbase4:42471] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42471%2C1676261032736.meta:.meta(num 1676261033347) 2023-02-13 04:03:56,100 DEBUG [RS:0;jenkins-hbase4:42471] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/oldWALs 2023-02-13 04:03:56,100 INFO [RS:0;jenkins-hbase4:42471] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42471%2C1676261032736:(num 1676261033756) 2023-02-13 04:03:56,100 DEBUG [RS:0;jenkins-hbase4:42471] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:56,100 INFO [RS:0;jenkins-hbase4:42471] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:03:56,100 INFO [RS:0;jenkins-hbase4:42471] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 04:03:56,100 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:03:56,101 INFO [RS:0;jenkins-hbase4:42471] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42471 2023-02-13 04:03:56,103 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42471,1676261032736 2023-02-13 04:03:56,103 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:56,103 ERROR [Listener at localhost/37903-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4909f6ae rejected from java.util.concurrent.ThreadPoolExecutor@4d367b57[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:56,103 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42471,1676261032736] 2023-02-13 04:03:56,104 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42471,1676261032736; numProcessing=2 2023-02-13 04:03:56,106 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42471,1676261032736 already deleted, retry=false 2023-02-13 04:03:56,106 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42471,1676261032736 expired; onlineServers=0 2023-02-13 04:03:56,106 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39703,1676261032689' ***** 2023-02-13 04:03:56,106 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 04:03:56,107 DEBUG [M:0;jenkins-hbase4:39703] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f0d8cc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:56,107 INFO [M:0;jenkins-hbase4:39703] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39703,1676261032689 2023-02-13 04:03:56,107 INFO [M:0;jenkins-hbase4:39703] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39703,1676261032689; all regions closed. 2023-02-13 04:03:56,107 DEBUG [M:0;jenkins-hbase4:39703] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:56,107 DEBUG [M:0;jenkins-hbase4:39703] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 04:03:56,107 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 04:03:56,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261032976] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261032976,5,FailOnTimeoutGroup] 2023-02-13 04:03:56,107 DEBUG [M:0;jenkins-hbase4:39703] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 04:03:56,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261032980] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261032980,5,FailOnTimeoutGroup] 2023-02-13 04:03:56,108 INFO [M:0;jenkins-hbase4:39703] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 04:03:56,109 INFO [M:0;jenkins-hbase4:39703] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 04:03:56,109 INFO [M:0;jenkins-hbase4:39703] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 04:03:56,109 DEBUG [M:0;jenkins-hbase4:39703] master.HMaster(1502): Stopping service threads 2023-02-13 04:03:56,109 INFO [M:0;jenkins-hbase4:39703] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 04:03:56,109 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:56,109 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:56,110 ERROR [M:0;jenkins-hbase4:39703] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 04:03:56,110 INFO [M:0;jenkins-hbase4:39703] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 04:03:56,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:56,110 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 04:03:56,110 DEBUG [M:0;jenkins-hbase4:39703] zookeeper.ZKUtil(398): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 04:03:56,110 WARN [M:0;jenkins-hbase4:39703] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 04:03:56,110 INFO [M:0;jenkins-hbase4:39703] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 04:03:56,111 INFO [M:0;jenkins-hbase4:39703] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 04:03:56,111 DEBUG [M:0;jenkins-hbase4:39703] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:03:56,111 INFO [M:0;jenkins-hbase4:39703] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:56,111 DEBUG [M:0;jenkins-hbase4:39703] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:56,111 DEBUG [M:0;jenkins-hbase4:39703] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:03:56,111 DEBUG [M:0;jenkins-hbase4:39703] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:56,111 INFO [M:0;jenkins-hbase4:39703] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.89 KB heapSize=66.83 KB 2023-02-13 04:03:56,120 INFO [M:0;jenkins-hbase4:39703] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.89 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ee89f22946dd4308b9b4c0dcc485eca6 2023-02-13 04:03:56,124 DEBUG [M:0;jenkins-hbase4:39703] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ee89f22946dd4308b9b4c0dcc485eca6 as hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ee89f22946dd4308b9b4c0dcc485eca6 2023-02-13 04:03:56,127 INFO [M:0;jenkins-hbase4:39703] regionserver.HStore(1080): Added hdfs://localhost:42061/user/jenkins/test-data/4dacb70c-5556-3ea0-8231-71994b6e2fd7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ee89f22946dd4308b9b4c0dcc485eca6, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 04:03:56,128 INFO [M:0;jenkins-hbase4:39703] regionserver.HRegion(2947): Finished flush of dataSize ~55.89 KB/57229, heapSize ~66.81 KB/68416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-13 04:03:56,129 INFO [M:0;jenkins-hbase4:39703] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:56,129 DEBUG [M:0;jenkins-hbase4:39703] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261036111Disabling compacts and flushes for region at 1676261036111Disabling writes for close at 1676261036111Obtaining lock to block concurrent updates at 1676261036111Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676261036111Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57229, getHeapSize=68416, getOffHeapSize=0, getCellsCount=145 at 1676261036111Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676261036112 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676261036112Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676261036115 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676261036115Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676261036124 (+9 ms)Finished flush of dataSize ~55.89 KB/57229, heapSize ~66.81 KB/68416, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676261036128 (+4 ms)Writing region close event to WAL at 1676261036129 (+1 ms)Closed at 1676261036129 2023-02-13 04:03:56,131 INFO [M:0;jenkins-hbase4:39703] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 04:03:56,131 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:03:56,132 INFO [M:0;jenkins-hbase4:39703] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39703 2023-02-13 04:03:56,133 DEBUG [M:0;jenkins-hbase4:39703] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39703,1676261032689 already deleted, retry=false 2023-02-13 04:03:56,483 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:56,483 INFO [M:0;jenkins-hbase4:39703] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39703,1676261032689; zookeeper connection closed. 2023-02-13 04:03:56,483 ERROR [Listener at localhost/37903-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26ddb80f rejected from java.util.concurrent.ThreadPoolExecutor@22e2280c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:56,483 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): master:39703-0x1004bd96ca20000, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:56,484 ERROR [Listener at localhost/37903-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d1b0c17 rejected from java.util.concurrent.ThreadPoolExecutor@22e2280c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:56,583 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:56,583 INFO [RS:0;jenkins-hbase4:42471] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42471,1676261032736; zookeeper connection closed. 2023-02-13 04:03:56,583 ERROR [Listener at localhost/37903-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3fcc9a9c rejected from java.util.concurrent.ThreadPoolExecutor@4d367b57[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:56,583 DEBUG [Listener at localhost/37903-EventThread] zookeeper.ZKWatcher(600): regionserver:42471-0x1004bd96ca20001, quorum=127.0.0.1:62833, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:03:56,583 ERROR [Listener at localhost/37903-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@47648ff7 rejected from java.util.concurrent.ThreadPoolExecutor@4d367b57[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:03:56,583 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4ec86b27] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4ec86b27 2023-02-13 04:03:56,583 INFO [Listener at localhost/37903] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 04:03:56,584 WARN [Listener at localhost/37903] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:03:56,587 INFO [Listener at localhost/37903] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:03:56,693 WARN [BP-2126154231-172.31.14.131-1676261032062 heartbeating to localhost/127.0.0.1:42061] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:03:56,693 WARN [BP-2126154231-172.31.14.131-1676261032062 heartbeating to localhost/127.0.0.1:42061] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2126154231-172.31.14.131-1676261032062 (Datanode Uuid 8e44ba37-4db8-4829-ba6d-284df70486f5) service to localhost/127.0.0.1:42061 2023-02-13 04:03:56,694 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/cluster_4b2d3994-d374-6947-03e8-8998e82dae97/dfs/data/data3/current/BP-2126154231-172.31.14.131-1676261032062] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:56,695 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/cluster_4b2d3994-d374-6947-03e8-8998e82dae97/dfs/data/data4/current/BP-2126154231-172.31.14.131-1676261032062] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:56,696 WARN [Listener at localhost/37903] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:03:56,699 INFO [Listener at localhost/37903] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:03:56,804 WARN [BP-2126154231-172.31.14.131-1676261032062 heartbeating to localhost/127.0.0.1:42061] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:03:56,804 WARN [BP-2126154231-172.31.14.131-1676261032062 heartbeating to localhost/127.0.0.1:42061] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2126154231-172.31.14.131-1676261032062 (Datanode Uuid 63414c1f-8031-4832-9196-87d91fad4776) service to localhost/127.0.0.1:42061 2023-02-13 04:03:56,805 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/cluster_4b2d3994-d374-6947-03e8-8998e82dae97/dfs/data/data1/current/BP-2126154231-172.31.14.131-1676261032062] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:56,805 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/cluster_4b2d3994-d374-6947-03e8-8998e82dae97/dfs/data/data2/current/BP-2126154231-172.31.14.131-1676261032062] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:03:56,815 INFO [Listener at localhost/37903] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:03:56,928 INFO [Listener at localhost/37903] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 04:03:56,943 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 04:03:56,956 INFO [Listener at localhost/37903] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=179 (was 159) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42061 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:42061 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37903 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:42061 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:42061 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:42061 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:42061 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39703,1676261032689)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:42061 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=565 (was 535) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=273 (was 261) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3936 (was 3961) 2023-02-13 04:03:56,964 INFO [Listener at localhost/37903] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=179, OpenFileDescriptor=565, MaxFileDescriptor=60000, SystemLoadAverage=273, ProcessCount=168, AvailableMemoryMB=3936 2023-02-13 04:03:56,975 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/hadoop.log.dir so I do NOT create it in target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76 2023-02-13 04:03:56,975 WARN [Listener at localhost/37903] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 04:03:56,975 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/hadoop.tmp.dir so I do NOT create it in target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76 2023-02-13 04:03:56,975 WARN [Listener at localhost/37903] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ddb0128c-c08d-5fdd-5c5b-3edc9060e66d/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 04:03:56,975 DEBUG [Listener at localhost/37903] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76 2023-02-13 04:03:56,975 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 04:03:56,975 INFO [Listener at localhost/37903] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/cluster_cea7a04b-7fef-5ea0-8547-5bd45884438e, deleteOnExit=true 2023-02-13 04:03:56,975 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 04:03:56,975 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/test.cache.data in system properties and HBase conf 2023-02-13 04:03:56,975 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 04:03:56,976 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/hadoop.log.dir in system properties and HBase conf 2023-02-13 04:03:56,976 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 04:03:56,976 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 04:03:56,976 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 04:03:56,976 DEBUG [Listener at localhost/37903] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 04:03:56,976 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:03:56,976 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:03:56,976 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 04:03:56,976 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:03:56,976 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 04:03:56,977 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 04:03:56,977 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:03:56,977 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:03:56,977 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 04:03:56,977 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/nfs.dump.dir in system properties and HBase conf 2023-02-13 04:03:56,977 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/java.io.tmpdir in system properties and HBase conf 2023-02-13 04:03:56,977 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:03:56,977 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 04:03:56,977 INFO [Listener at localhost/37903] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 04:03:56,981 WARN [Listener at localhost/37903] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:03:56,981 WARN [Listener at localhost/37903] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:03:57,023 WARN [Listener at localhost/37903] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:57,025 INFO [Listener at localhost/37903] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:57,029 INFO [Listener at localhost/37903] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/java.io.tmpdir/Jetty_localhost_44533_hdfs____i62vsv/webapp 2023-02-13 04:03:57,121 INFO [Listener at localhost/37903] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44533 2023-02-13 04:03:57,125 WARN [Listener at localhost/37903] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:03:57,125 WARN [Listener at localhost/37903] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:03:57,172 WARN [Listener at localhost/46273] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:57,185 WARN [Listener at localhost/46273] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:03:57,188 WARN [Listener at localhost/46273] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:57,189 INFO [Listener at localhost/46273] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:57,193 INFO [Listener at localhost/46273] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/java.io.tmpdir/Jetty_localhost_36401_datanode____yz3c9l/webapp 2023-02-13 04:03:57,284 INFO [Listener at localhost/46273] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36401 2023-02-13 04:03:57,291 WARN [Listener at localhost/33949] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:57,311 WARN [Listener at localhost/33949] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:03:57,355 WARN [Listener at localhost/33949] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:03:57,356 INFO [Listener at localhost/33949] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:03:57,363 INFO [Listener at localhost/33949] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/java.io.tmpdir/Jetty_localhost_46721_datanode____.qmq71h/webapp 2023-02-13 04:03:57,418 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1557438b9e6b8809: Processing first storage report for DS-b0ca2572-c66e-4478-aacf-40a8746c54d0 from datanode dfaa24bf-1823-470e-b35d-f6f614076ee4 2023-02-13 04:03:57,418 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1557438b9e6b8809: from storage DS-b0ca2572-c66e-4478-aacf-40a8746c54d0 node DatanodeRegistration(127.0.0.1:39049, datanodeUuid=dfaa24bf-1823-470e-b35d-f6f614076ee4, infoPort=39401, infoSecurePort=0, ipcPort=33949, storageInfo=lv=-57;cid=testClusterID;nsid=240099070;c=1676261036983), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:57,418 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1557438b9e6b8809: Processing first storage report for DS-d2cfc44b-0aa0-4680-b54c-a8baa2065af9 from datanode dfaa24bf-1823-470e-b35d-f6f614076ee4 2023-02-13 04:03:57,418 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1557438b9e6b8809: from storage DS-d2cfc44b-0aa0-4680-b54c-a8baa2065af9 node DatanodeRegistration(127.0.0.1:39049, datanodeUuid=dfaa24bf-1823-470e-b35d-f6f614076ee4, infoPort=39401, infoSecurePort=0, ipcPort=33949, storageInfo=lv=-57;cid=testClusterID;nsid=240099070;c=1676261036983), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:57,464 INFO [Listener at localhost/33949] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46721 2023-02-13 04:03:57,472 WARN [Listener at localhost/36569] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:03:57,563 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x96fd658d471e9404: Processing first storage report for DS-7305340d-6d4f-46ee-92cc-73fd6231a63d from datanode bef7f218-87b0-4f63-b23a-d3eb4508d388 2023-02-13 04:03:57,563 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x96fd658d471e9404: from storage DS-7305340d-6d4f-46ee-92cc-73fd6231a63d node DatanodeRegistration(127.0.0.1:46247, datanodeUuid=bef7f218-87b0-4f63-b23a-d3eb4508d388, infoPort=35617, infoSecurePort=0, ipcPort=36569, storageInfo=lv=-57;cid=testClusterID;nsid=240099070;c=1676261036983), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:57,563 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x96fd658d471e9404: Processing first storage report for DS-8bd8fac6-43f7-487b-aa23-ec02d8836d2c from datanode bef7f218-87b0-4f63-b23a-d3eb4508d388 2023-02-13 04:03:57,563 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x96fd658d471e9404: from storage DS-8bd8fac6-43f7-487b-aa23-ec02d8836d2c node DatanodeRegistration(127.0.0.1:46247, datanodeUuid=bef7f218-87b0-4f63-b23a-d3eb4508d388, infoPort=35617, infoSecurePort=0, ipcPort=36569, storageInfo=lv=-57;cid=testClusterID;nsid=240099070;c=1676261036983), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:03:57,583 DEBUG [Listener at localhost/36569] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76 2023-02-13 04:03:57,585 INFO [Listener at localhost/36569] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/cluster_cea7a04b-7fef-5ea0-8547-5bd45884438e/zookeeper_0, clientPort=63217, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/cluster_cea7a04b-7fef-5ea0-8547-5bd45884438e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/cluster_cea7a04b-7fef-5ea0-8547-5bd45884438e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 04:03:57,586 INFO [Listener at localhost/36569] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63217 2023-02-13 04:03:57,586 INFO [Listener at localhost/36569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,587 INFO [Listener at localhost/36569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,599 INFO [Listener at localhost/36569] util.FSUtils(479): Created version file at hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820 with version=8 2023-02-13 04:03:57,599 INFO [Listener at localhost/36569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,600 INFO [Listener at localhost/36569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,601 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/hbase-staging 2023-02-13 04:03:57,603 INFO [Listener at localhost/36569] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:57,603 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:57,603 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:57,603 INFO [Listener at localhost/36569] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:57,603 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:57,603 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:57,603 INFO [Listener at localhost/36569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:57,604 INFO [Listener at localhost/36569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42999 2023-02-13 04:03:57,604 INFO [Listener at localhost/36569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,605 INFO [Listener at localhost/36569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,606 INFO [Listener at localhost/36569] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42999 connecting to ZooKeeper ensemble=127.0.0.1:63217 2023-02-13 04:03:57,612 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:429990x0, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:57,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42999-0x1004bd97fd50000 connected 2023-02-13 04:03:57,630 DEBUG [Listener at localhost/36569] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:57,630 DEBUG [Listener at localhost/36569] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:57,630 DEBUG [Listener at localhost/36569] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:57,632 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42999 2023-02-13 04:03:57,632 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42999 2023-02-13 04:03:57,636 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42999 2023-02-13 04:03:57,636 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42999 2023-02-13 04:03:57,637 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42999 2023-02-13 04:03:57,637 INFO [Listener at localhost/36569] master.HMaster(439): hbase.rootdir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820, hbase.cluster.distributed=false 2023-02-13 04:03:57,649 INFO [Listener at localhost/36569] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:57,649 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:57,649 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:57,649 INFO [Listener at localhost/36569] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:57,649 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:57,650 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:57,650 INFO [Listener at localhost/36569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:57,650 INFO [Listener at localhost/36569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41381 2023-02-13 04:03:57,651 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:03:57,652 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:57,652 INFO [Listener at localhost/36569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,653 INFO [Listener at localhost/36569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,654 INFO [Listener at localhost/36569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41381 connecting to ZooKeeper ensemble=127.0.0.1:63217 2023-02-13 04:03:57,657 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:413810x0, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:57,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41381-0x1004bd97fd50001 connected 2023-02-13 04:03:57,658 DEBUG [Listener at localhost/36569] zookeeper.ZKUtil(164): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:57,659 DEBUG [Listener at localhost/36569] zookeeper.ZKUtil(164): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:57,659 DEBUG [Listener at localhost/36569] zookeeper.ZKUtil(164): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:57,660 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41381 2023-02-13 04:03:57,661 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41381 2023-02-13 04:03:57,661 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41381 2023-02-13 04:03:57,664 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41381 2023-02-13 04:03:57,664 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41381 2023-02-13 04:03:57,674 INFO [Listener at localhost/36569] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:03:57,674 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:57,675 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:57,675 INFO [Listener at localhost/36569] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:03:57,675 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:03:57,675 INFO [Listener at localhost/36569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:03:57,675 INFO [Listener at localhost/36569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:03:57,675 INFO [Listener at localhost/36569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39517 2023-02-13 04:03:57,676 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:03:57,677 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:03:57,678 INFO [Listener at localhost/36569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,678 INFO [Listener at localhost/36569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,679 INFO [Listener at localhost/36569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39517 connecting to ZooKeeper ensemble=127.0.0.1:63217 2023-02-13 04:03:57,682 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:395170x0, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:03:57,684 DEBUG [Listener at localhost/36569] zookeeper.ZKUtil(164): regionserver:395170x0, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:03:57,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39517-0x1004bd97fd50002 connected 2023-02-13 04:03:57,684 DEBUG [Listener at localhost/36569] zookeeper.ZKUtil(164): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:03:57,685 DEBUG [Listener at localhost/36569] zookeeper.ZKUtil(164): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:03:57,686 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39517 2023-02-13 04:03:57,687 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39517 2023-02-13 04:03:57,688 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39517 2023-02-13 04:03:57,689 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39517 2023-02-13 04:03:57,690 DEBUG [Listener at localhost/36569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39517 2023-02-13 04:03:57,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42999,1676261037602 2023-02-13 04:03:57,695 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:03:57,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42999,1676261037602 2023-02-13 04:03:57,697 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:57,697 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:57,697 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:03:57,698 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:57,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:03:57,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42999,1676261037602 from backup master directory 2023-02-13 04:03:57,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:03:57,700 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42999,1676261037602 2023-02-13 04:03:57,700 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:03:57,700 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:57,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42999,1676261037602 2023-02-13 04:03:57,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/hbase.id with ID: c47db7e5-1f4e-46d9-944b-dc3352ea9ddc 2023-02-13 04:03:57,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:03:57,726 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:57,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x338ef415 to 127.0.0.1:63217 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:57,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4328ad15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:57,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:57,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 04:03:57,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:57,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/data/master/store-tmp 2023-02-13 04:03:57,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:57,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:03:57,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:57,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:57,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:03:57,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:57,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:03:57,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261037750Disabling compacts and flushes for region at 1676261037750Disabling writes for close at 1676261037750Writing region close event to WAL at 1676261037750Closed at 1676261037750 2023-02-13 04:03:57,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/WALs/jenkins-hbase4.apache.org,42999,1676261037602 2023-02-13 04:03:57,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42999%2C1676261037602, suffix=, logDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/WALs/jenkins-hbase4.apache.org,42999,1676261037602, archiveDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/oldWALs, maxLogs=10 2023-02-13 04:03:57,772 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46247,DS-7305340d-6d4f-46ee-92cc-73fd6231a63d,DISK] 2023-02-13 04:03:57,773 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39049,DS-b0ca2572-c66e-4478-aacf-40a8746c54d0,DISK] 2023-02-13 04:03:57,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/WALs/jenkins-hbase4.apache.org,42999,1676261037602/jenkins-hbase4.apache.org%2C42999%2C1676261037602.1676261037754 2023-02-13 04:03:57,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46247,DS-7305340d-6d4f-46ee-92cc-73fd6231a63d,DISK], DatanodeInfoWithStorage[127.0.0.1:39049,DS-b0ca2572-c66e-4478-aacf-40a8746c54d0,DISK]] 2023-02-13 04:03:57,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:57,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:57,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:57,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:57,777 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:57,778 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 04:03:57,779 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 04:03:57,779 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:57,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:57,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:57,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:03:57,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:57,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61656373, jitterRate=-0.0812484472990036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:03:57,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676261037776Initializing all the Stores at 1676261037777 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261037777Cleaning up temporary data from old regions at 1676261037781 (+4 ms)Cleaning up detritus from prior splits at 1676261037781Region opened successfully at 1676261037785 (+4 ms) 2023-02-13 04:03:57,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 04:03:57,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 04:03:57,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 04:03:57,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 04:03:57,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 04:03:57,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 04:03:57,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 04:03:57,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 04:03:57,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 04:03:57,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 04:03:57,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 04:03:57,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 04:03:57,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 04:03:57,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 04:03:57,807 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:57,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 04:03:57,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 04:03:57,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 04:03:57,810 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:57,810 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:57,810 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:03:57,810 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:57,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42999,1676261037602, sessionid=0x1004bd97fd50000, setting cluster-up flag (Was=false) 2023-02-13 04:03:57,816 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:57,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 04:03:57,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42999,1676261037602 2023-02-13 04:03:57,823 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:57,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 04:03:57,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42999,1676261037602 2023-02-13 04:03:57,828 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.hbase-snapshot/.tmp 2023-02-13 04:03:57,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:57,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:57,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:57,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:57,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:03:57,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 04:03:57,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:57,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676261067837 2023-02-13 04:03:57,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 04:03:57,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 04:03:57,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 04:03:57,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 04:03:57,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 04:03:57,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 04:03:57,838 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:57,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,839 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 04:03:57,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 04:03:57,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 04:03:57,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 04:03:57,841 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:57,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 04:03:57,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 04:03:57,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261037848,5,FailOnTimeoutGroup] 2023-02-13 04:03:57,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261037848,5,FailOnTimeoutGroup] 2023-02-13 04:03:57,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 04:03:57,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,857 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:57,858 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:57,858 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820 2023-02-13 04:03:57,867 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:57,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:03:57,873 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/info 2023-02-13 04:03:57,873 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:03:57,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:57,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:03:57,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:57,875 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:03:57,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:57,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:03:57,877 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/table 2023-02-13 04:03:57,877 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:03:57,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:57,878 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740 2023-02-13 04:03:57,879 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740 2023-02-13 04:03:57,881 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:03:57,882 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:03:57,884 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:57,884 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62588662, jitterRate=-0.06735625863075256}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:03:57,884 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676261037867Initializing all the Stores at 1676261037868 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261037868Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261037872 (+4 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261037872Cleaning up temporary data from old regions at 1676261037880 (+8 ms)Cleaning up detritus from prior splits at 1676261037880Region opened successfully at 1676261037884 (+4 ms) 2023-02-13 04:03:57,885 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:03:57,885 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:03:57,885 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:03:57,885 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:03:57,885 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:03:57,885 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:03:57,885 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261037885Disabling compacts and flushes for region at 1676261037885Disabling writes for close at 1676261037885Writing region close event to WAL at 1676261037885Closed at 1676261037885 2023-02-13 04:03:57,886 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:03:57,886 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 04:03:57,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 04:03:57,888 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 04:03:57,890 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 04:03:57,893 INFO [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(952): ClusterId : c47db7e5-1f4e-46d9-944b-dc3352ea9ddc 2023-02-13 04:03:57,893 INFO [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(952): ClusterId : c47db7e5-1f4e-46d9-944b-dc3352ea9ddc 2023-02-13 04:03:57,893 DEBUG [RS:1;jenkins-hbase4:39517] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:03:57,894 DEBUG [RS:0;jenkins-hbase4:41381] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:03:57,895 DEBUG [RS:1;jenkins-hbase4:39517] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:03:57,895 DEBUG [RS:1;jenkins-hbase4:39517] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:03:57,895 DEBUG [RS:0;jenkins-hbase4:41381] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:03:57,895 DEBUG [RS:0;jenkins-hbase4:41381] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:03:57,897 DEBUG [RS:1;jenkins-hbase4:39517] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:03:57,898 DEBUG [RS:1;jenkins-hbase4:39517] zookeeper.ReadOnlyZKClient(139): Connect 0x536d34a2 to 127.0.0.1:63217 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:57,898 DEBUG [RS:0;jenkins-hbase4:41381] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:03:57,900 DEBUG [RS:0;jenkins-hbase4:41381] zookeeper.ReadOnlyZKClient(139): Connect 0x10fbf164 to 127.0.0.1:63217 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:57,905 DEBUG [RS:1;jenkins-hbase4:39517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5daad0bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:57,905 DEBUG [RS:1;jenkins-hbase4:39517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59955fd2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:57,905 DEBUG [RS:0;jenkins-hbase4:41381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e3c0d0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:57,905 DEBUG [RS:0;jenkins-hbase4:41381] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a039a14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:03:57,913 DEBUG [RS:1;jenkins-hbase4:39517] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39517 2023-02-13 04:03:57,913 INFO [RS:1;jenkins-hbase4:39517] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:03:57,913 INFO [RS:1;jenkins-hbase4:39517] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:03:57,913 DEBUG [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:03:57,914 INFO [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42999,1676261037602 with isa=jenkins-hbase4.apache.org/172.31.14.131:39517, startcode=1676261037674 2023-02-13 04:03:57,914 DEBUG [RS:1;jenkins-hbase4:39517] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:03:57,916 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35213, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:03:57,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:57,918 DEBUG [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820 2023-02-13 04:03:57,918 DEBUG [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46273 2023-02-13 04:03:57,918 DEBUG [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:03:57,918 DEBUG [RS:0;jenkins-hbase4:41381] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41381 2023-02-13 04:03:57,918 INFO [RS:0;jenkins-hbase4:41381] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:03:57,918 INFO [RS:0;jenkins-hbase4:41381] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:03:57,918 DEBUG [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:03:57,919 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:57,919 INFO [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42999,1676261037602 with isa=jenkins-hbase4.apache.org/172.31.14.131:41381, startcode=1676261037649 2023-02-13 04:03:57,919 DEBUG [RS:0;jenkins-hbase4:41381] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:03:57,919 DEBUG [RS:1;jenkins-hbase4:39517] zookeeper.ZKUtil(162): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:57,920 WARN [RS:1;jenkins-hbase4:39517] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:57,920 INFO [RS:1;jenkins-hbase4:39517] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:57,920 DEBUG [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/WALs/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:57,920 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39517,1676261037674] 2023-02-13 04:03:57,924 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34185, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:03:57,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:57,926 DEBUG [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820 2023-02-13 04:03:57,926 DEBUG [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:46273 2023-02-13 04:03:57,926 DEBUG [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:03:57,931 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:03:57,931 DEBUG [RS:1;jenkins-hbase4:39517] zookeeper.ZKUtil(162): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:57,931 DEBUG [RS:0;jenkins-hbase4:41381] zookeeper.ZKUtil(162): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:57,932 WARN [RS:0;jenkins-hbase4:41381] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:03:57,932 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41381,1676261037649] 2023-02-13 04:03:57,932 INFO [RS:0;jenkins-hbase4:41381] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:57,932 DEBUG [RS:1;jenkins-hbase4:39517] zookeeper.ZKUtil(162): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:57,932 DEBUG [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1947): logDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/WALs/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:57,933 DEBUG [RS:1;jenkins-hbase4:39517] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:03:57,933 INFO [RS:1;jenkins-hbase4:39517] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:03:57,937 INFO [RS:1;jenkins-hbase4:39517] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:03:57,938 INFO [RS:1;jenkins-hbase4:39517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:03:57,938 INFO [RS:1;jenkins-hbase4:39517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,939 INFO [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:03:57,940 DEBUG [RS:0;jenkins-hbase4:41381] zookeeper.ZKUtil(162): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:57,940 INFO [RS:1;jenkins-hbase4:39517] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,940 DEBUG [RS:1;jenkins-hbase4:39517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,940 DEBUG [RS:0;jenkins-hbase4:41381] zookeeper.ZKUtil(162): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:57,940 DEBUG [RS:1;jenkins-hbase4:39517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,940 DEBUG [RS:1;jenkins-hbase4:39517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,940 DEBUG [RS:1;jenkins-hbase4:39517] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,940 DEBUG [RS:1;jenkins-hbase4:39517] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,940 DEBUG [RS:1;jenkins-hbase4:39517] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:57,940 DEBUG [RS:1;jenkins-hbase4:39517] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,940 DEBUG [RS:1;jenkins-hbase4:39517] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,941 DEBUG [RS:1;jenkins-hbase4:39517] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,941 DEBUG [RS:1;jenkins-hbase4:39517] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,941 DEBUG [RS:0;jenkins-hbase4:41381] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:03:57,941 INFO [RS:0;jenkins-hbase4:41381] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:03:57,944 INFO [RS:0;jenkins-hbase4:41381] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:03:57,944 INFO [RS:1;jenkins-hbase4:39517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,944 INFO [RS:1;jenkins-hbase4:39517] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,944 INFO [RS:1;jenkins-hbase4:39517] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,945 INFO [RS:0;jenkins-hbase4:41381] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:03:57,945 INFO [RS:0;jenkins-hbase4:41381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,945 INFO [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:03:57,946 INFO [RS:0;jenkins-hbase4:41381] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,947 DEBUG [RS:0;jenkins-hbase4:41381] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,947 DEBUG [RS:0;jenkins-hbase4:41381] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,947 DEBUG [RS:0;jenkins-hbase4:41381] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,947 DEBUG [RS:0;jenkins-hbase4:41381] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,947 DEBUG [RS:0;jenkins-hbase4:41381] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,947 DEBUG [RS:0;jenkins-hbase4:41381] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:03:57,947 DEBUG [RS:0;jenkins-hbase4:41381] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,947 DEBUG [RS:0;jenkins-hbase4:41381] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,947 DEBUG [RS:0;jenkins-hbase4:41381] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,947 DEBUG [RS:0;jenkins-hbase4:41381] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:03:57,948 INFO [RS:0;jenkins-hbase4:41381] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,948 INFO [RS:0;jenkins-hbase4:41381] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,948 INFO [RS:0;jenkins-hbase4:41381] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,962 INFO [RS:1;jenkins-hbase4:39517] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:03:57,962 INFO [RS:1;jenkins-hbase4:39517] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39517,1676261037674-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,965 INFO [RS:0;jenkins-hbase4:41381] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:03:57,965 INFO [RS:0;jenkins-hbase4:41381] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41381,1676261037649-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:57,975 INFO [RS:0;jenkins-hbase4:41381] regionserver.Replication(203): jenkins-hbase4.apache.org,41381,1676261037649 started 2023-02-13 04:03:57,975 INFO [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41381,1676261037649, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41381, sessionid=0x1004bd97fd50001 2023-02-13 04:03:57,975 DEBUG [RS:0;jenkins-hbase4:41381] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:03:57,975 DEBUG [RS:0;jenkins-hbase4:41381] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:57,975 DEBUG [RS:0;jenkins-hbase4:41381] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41381,1676261037649' 2023-02-13 04:03:57,975 DEBUG [RS:0;jenkins-hbase4:41381] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:57,976 DEBUG [RS:0;jenkins-hbase4:41381] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:57,976 DEBUG [RS:0;jenkins-hbase4:41381] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:03:57,976 DEBUG [RS:0;jenkins-hbase4:41381] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:03:57,976 DEBUG [RS:0;jenkins-hbase4:41381] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:57,976 DEBUG [RS:0;jenkins-hbase4:41381] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41381,1676261037649' 2023-02-13 04:03:57,976 DEBUG [RS:0;jenkins-hbase4:41381] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:57,976 DEBUG [RS:0;jenkins-hbase4:41381] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:57,977 DEBUG [RS:0;jenkins-hbase4:41381] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:03:57,977 INFO [RS:0;jenkins-hbase4:41381] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:03:57,977 INFO [RS:0;jenkins-hbase4:41381] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:03:57,977 INFO [RS:1;jenkins-hbase4:39517] regionserver.Replication(203): jenkins-hbase4.apache.org,39517,1676261037674 started 2023-02-13 04:03:57,977 INFO [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39517,1676261037674, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39517, sessionid=0x1004bd97fd50002 2023-02-13 04:03:57,977 DEBUG [RS:1;jenkins-hbase4:39517] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:03:57,977 DEBUG [RS:1;jenkins-hbase4:39517] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:57,977 DEBUG [RS:1;jenkins-hbase4:39517] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39517,1676261037674' 2023-02-13 04:03:57,977 DEBUG [RS:1;jenkins-hbase4:39517] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:03:57,977 DEBUG [RS:1;jenkins-hbase4:39517] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:03:57,978 DEBUG [RS:1;jenkins-hbase4:39517] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:03:57,978 DEBUG [RS:1;jenkins-hbase4:39517] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:03:57,978 DEBUG [RS:1;jenkins-hbase4:39517] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:57,978 DEBUG [RS:1;jenkins-hbase4:39517] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39517,1676261037674' 2023-02-13 04:03:57,978 DEBUG [RS:1;jenkins-hbase4:39517] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:03:57,978 DEBUG [RS:1;jenkins-hbase4:39517] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:57,978 DEBUG [RS:1;jenkins-hbase4:39517] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:03:57,978 INFO [RS:1;jenkins-hbase4:39517] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:03:57,978 INFO [RS:1;jenkins-hbase4:39517] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:03:58,040 DEBUG [jenkins-hbase4:42999] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 04:03:58,040 DEBUG [jenkins-hbase4:42999] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:58,042 DEBUG [jenkins-hbase4:42999] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:58,042 DEBUG [jenkins-hbase4:42999] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:58,042 DEBUG [jenkins-hbase4:42999] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:58,043 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41381,1676261037649, state=OPENING 2023-02-13 04:03:58,045 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 04:03:58,046 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:58,046 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:03:58,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:03:58,201 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:58,201 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:03:58,203 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54098, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:03:58,207 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 04:03:58,207 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:03:58,209 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41381%2C1676261037649.meta, suffix=.meta, logDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/WALs/jenkins-hbase4.apache.org,41381,1676261037649, archiveDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/oldWALs, maxLogs=32 2023-02-13 04:03:58,222 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39049,DS-b0ca2572-c66e-4478-aacf-40a8746c54d0,DISK] 2023-02-13 04:03:58,224 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46247,DS-7305340d-6d4f-46ee-92cc-73fd6231a63d,DISK] 2023-02-13 04:03:58,225 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/WALs/jenkins-hbase4.apache.org,41381,1676261037649/jenkins-hbase4.apache.org%2C41381%2C1676261037649.meta.1676261038209.meta 2023-02-13 04:03:58,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39049,DS-b0ca2572-c66e-4478-aacf-40a8746c54d0,DISK], DatanodeInfoWithStorage[127.0.0.1:46247,DS-7305340d-6d4f-46ee-92cc-73fd6231a63d,DISK]] 2023-02-13 04:03:58,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:58,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 04:03:58,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 04:03:58,226 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 04:03:58,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 04:03:58,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:58,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 04:03:58,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 04:03:58,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:03:58,228 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/info 2023-02-13 04:03:58,228 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/info 2023-02-13 04:03:58,229 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:03:58,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:58,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:03:58,230 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:58,230 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:03:58,230 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:03:58,231 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:58,231 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:03:58,231 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/table 2023-02-13 04:03:58,231 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/table 2023-02-13 04:03:58,232 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:03:58,232 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:58,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740 2023-02-13 04:03:58,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740 2023-02-13 04:03:58,235 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:03:58,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:03:58,236 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62697663, jitterRate=-0.06573201715946198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:03:58,237 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676261038227Writing region info on filesystem at 1676261038227Initializing all the Stores at 1676261038227Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261038227Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261038227Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261038227Cleaning up temporary data from old regions at 1676261038234 (+7 ms)Cleaning up detritus from prior splits at 1676261038234Running coprocessor post-open hooks at 1676261038237 (+3 ms)Region opened successfully at 1676261038237 2023-02-13 04:03:58,237 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676261038201 2023-02-13 04:03:58,242 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 04:03:58,242 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 04:03:58,243 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41381,1676261037649, state=OPEN 2023-02-13 04:03:58,244 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 04:03:58,244 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:03:58,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 04:03:58,246 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41381,1676261037649 in 198 msec 2023-02-13 04:03:58,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 04:03:58,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 360 msec 2023-02-13 04:03:58,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 419 msec 2023-02-13 04:03:58,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676261037696, completionTime=-1 2023-02-13 04:03:58,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 04:03:58,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 04:03:58,253 DEBUG [hconnection-0x4722cb28-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:58,255 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54104, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:58,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 04:03:58,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676261098256 2023-02-13 04:03:58,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676261158256 2023-02-13 04:03:58,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-13 04:03:58,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42999,1676261037602-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:58,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42999,1676261037602-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:58,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42999,1676261037602-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:58,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42999, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:58,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 04:03:58,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 04:03:58,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:58,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 04:03:58,265 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 04:03:58,265 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:03:58,266 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:03:58,267 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:03:58,268 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce empty. 2023-02-13 04:03:58,268 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:03:58,268 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 04:03:58,282 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:58,283 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 181cf175e9c79a25d96d58c67e6d24ce, NAME => 'hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:58,298 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:58,299 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 181cf175e9c79a25d96d58c67e6d24ce, disabling compactions & flushes 2023-02-13 04:03:58,299 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:03:58,299 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:03:58,299 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. after waiting 0 ms 2023-02-13 04:03:58,299 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:03:58,299 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:03:58,299 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 181cf175e9c79a25d96d58c67e6d24ce: Waiting for close lock at 1676261038299Disabling compacts and flushes for region at 1676261038299Disabling writes for close at 1676261038299Writing region close event to WAL at 1676261038299Closed at 1676261038299 2023-02-13 04:03:58,302 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:03:58,303 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261038303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261038303"}]},"ts":"1676261038303"} 2023-02-13 04:03:58,306 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:03:58,307 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:03:58,307 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261038307"}]},"ts":"1676261038307"} 2023-02-13 04:03:58,308 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 04:03:58,311 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:58,312 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:58,312 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:58,312 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:58,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=181cf175e9c79a25d96d58c67e6d24ce, ASSIGN}] 2023-02-13 04:03:58,317 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=181cf175e9c79a25d96d58c67e6d24ce, ASSIGN 2023-02-13 04:03:58,317 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=181cf175e9c79a25d96d58c67e6d24ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39517,1676261037674; forceNewPlan=false, retain=false 2023-02-13 04:03:58,467 INFO [jenkins-hbase4:42999] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:03:58,469 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=181cf175e9c79a25d96d58c67e6d24ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:58,469 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261038469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261038469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261038469"}]},"ts":"1676261038469"} 2023-02-13 04:03:58,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 181cf175e9c79a25d96d58c67e6d24ce, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:03:58,623 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:58,624 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:03:58,625 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49308, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:03:58,629 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:03:58,630 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39517%2C1676261037674, suffix=, logDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/WALs/jenkins-hbase4.apache.org,39517,1676261037674, archiveDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/oldWALs, maxLogs=32 2023-02-13 04:03:58,644 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39049,DS-b0ca2572-c66e-4478-aacf-40a8746c54d0,DISK] 2023-02-13 04:03:58,644 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46247,DS-7305340d-6d4f-46ee-92cc-73fd6231a63d,DISK] 2023-02-13 04:03:58,646 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/WALs/jenkins-hbase4.apache.org,39517,1676261037674/jenkins-hbase4.apache.org%2C39517%2C1676261037674.1676261038631 2023-02-13 04:03:58,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39049,DS-b0ca2572-c66e-4478-aacf-40a8746c54d0,DISK], DatanodeInfoWithStorage[127.0.0.1:46247,DS-7305340d-6d4f-46ee-92cc-73fd6231a63d,DISK]] 2023-02-13 04:03:58,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 181cf175e9c79a25d96d58c67e6d24ce, NAME => 'hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:03:58,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:03:58,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:58,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:03:58,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:03:58,656 INFO [StoreOpener-181cf175e9c79a25d96d58c67e6d24ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:03:58,657 DEBUG [StoreOpener-181cf175e9c79a25d96d58c67e6d24ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce/info 2023-02-13 04:03:58,658 DEBUG [StoreOpener-181cf175e9c79a25d96d58c67e6d24ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce/info 2023-02-13 04:03:58,658 INFO [StoreOpener-181cf175e9c79a25d96d58c67e6d24ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 181cf175e9c79a25d96d58c67e6d24ce columnFamilyName info 2023-02-13 04:03:58,658 INFO [StoreOpener-181cf175e9c79a25d96d58c67e6d24ce-1] regionserver.HStore(310): Store=181cf175e9c79a25d96d58c67e6d24ce/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:58,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:03:58,660 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:03:58,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:03:58,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:58,664 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 181cf175e9c79a25d96d58c67e6d24ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72922144, jitterRate=0.0866246223449707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:03:58,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 181cf175e9c79a25d96d58c67e6d24ce: Running coprocessor pre-open hook at 1676261038649Writing region info on filesystem at 1676261038649Initializing all the Stores at 1676261038649Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261038649Cleaning up temporary data from old regions at 1676261038660 (+11 ms)Cleaning up detritus from prior splits at 1676261038660Running coprocessor post-open hooks at 1676261038664 (+4 ms)Region opened successfully at 1676261038664 2023-02-13 04:03:58,665 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce., pid=6, masterSystemTime=1676261038623 2023-02-13 04:03:58,669 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:03:58,670 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:03:58,670 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=181cf175e9c79a25d96d58c67e6d24ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:58,670 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261038670"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261038670"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261038670"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261038670"}]},"ts":"1676261038670"} 2023-02-13 04:03:58,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 04:03:58,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 181cf175e9c79a25d96d58c67e6d24ce, server=jenkins-hbase4.apache.org,39517,1676261037674 in 201 msec 2023-02-13 04:03:58,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 04:03:58,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=181cf175e9c79a25d96d58c67e6d24ce, ASSIGN in 361 msec 2023-02-13 04:03:58,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:03:58,675 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261038675"}]},"ts":"1676261038675"} 2023-02-13 04:03:58,676 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 04:03:58,679 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:03:58,680 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 415 msec 2023-02-13 04:03:58,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 04:03:58,767 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:58,767 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:03:58,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:58,770 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49310, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:58,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 04:03:58,780 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:58,782 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-13 04:03:58,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 04:03:58,790 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:03:58,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-13 04:03:58,797 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 04:03:58,800 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 04:03:58,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.100sec 2023-02-13 04:03:58,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 04:03:58,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 04:03:58,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 04:03:58,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42999,1676261037602-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 04:03:58,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42999,1676261037602-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 04:03:58,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 04:03:58,867 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 04:03:58,894 DEBUG [Listener at localhost/36569] zookeeper.ReadOnlyZKClient(139): Connect 0x28f258e7 to 127.0.0.1:63217 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:58,899 DEBUG [Listener at localhost/36569] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e849cf9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:58,901 DEBUG [hconnection-0x58ce421d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:58,903 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54116, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:58,906 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42999,1676261037602 2023-02-13 04:03:58,907 DEBUG [Listener at localhost/36569] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 04:03:58,909 DEBUG [Listener at localhost/36569] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:03:58,916 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57164, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:03:58,917 INFO [Listener at localhost/36569] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-13 04:03:58,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-13 04:03:58,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 04:03:58,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 93 connection: 172.31.14.131:57164 deadline: 1676261098917, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-13 04:03:58,918 INFO [Listener at localhost/36569] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-13 04:03:58,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:03:58,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:58,924 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:03:58,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-13 04:03:58,925 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:03:58,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:58,944 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:03:58,944 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:03:58,944 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:03:58,944 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:03:58,944 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:03:58,944 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:03:58,944 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b 2023-02-13 04:03:58,945 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2 empty. 2023-02-13 04:03:58,944 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8 2023-02-13 04:03:58,945 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0 empty. 2023-02-13 04:03:58,945 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef empty. 2023-02-13 04:03:58,945 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79 empty. 2023-02-13 04:03:58,945 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:03:58,945 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:03:58,946 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8 empty. 2023-02-13 04:03:58,945 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:03:58,946 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:03:58,946 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b empty. 2023-02-13 04:03:58,946 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:03:58,946 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b 2023-02-13 04:03:58,946 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a empty. 2023-02-13 04:03:58,946 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67 empty. 2023-02-13 04:03:58,946 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216 empty. 2023-02-13 04:03:58,947 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8 2023-02-13 04:03:58,947 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12 empty. 2023-02-13 04:03:58,947 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:03:58,947 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:03:58,947 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:03:58,947 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:03:58,947 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:03:58,947 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-13 04:03:58,960 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-13 04:03:58,961 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 81c803a453213180a0941d1de82923f8, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:58,962 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0560d2e09b5461c5d897c728ec0fb2e0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:58,962 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 84863e66b3da719eb4cb244e7c2cb3b2, NAME => 'testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:58,976 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:58,976 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 81c803a453213180a0941d1de82923f8, disabling compactions & flushes 2023-02-13 04:03:58,976 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:03:58,976 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:03:58,976 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. after waiting 0 ms 2023-02-13 04:03:58,976 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:03:58,976 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:03:58,976 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 81c803a453213180a0941d1de82923f8: Waiting for close lock at 1676261038976Disabling compacts and flushes for region at 1676261038976Disabling writes for close at 1676261038976Writing region close event to WAL at 1676261038976Closed at 1676261038976 2023-02-13 04:03:58,977 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 23600bfb9489de77511b8919349ae24b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:58,978 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:58,978 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 84863e66b3da719eb4cb244e7c2cb3b2, disabling compactions & flushes 2023-02-13 04:03:58,979 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:03:58,979 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:03:58,979 INFO [RS:0;jenkins-hbase4:41381] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41381%2C1676261037649, suffix=, logDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/WALs/jenkins-hbase4.apache.org,41381,1676261037649, archiveDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/oldWALs, maxLogs=32 2023-02-13 04:03:58,979 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. after waiting 0 ms 2023-02-13 04:03:58,979 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:03:58,979 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:03:58,979 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 84863e66b3da719eb4cb244e7c2cb3b2: Waiting for close lock at 1676261038978Disabling compacts and flushes for region at 1676261038978Disabling writes for close at 1676261038979 (+1 ms)Writing region close event to WAL at 1676261038979Closed at 1676261038979 2023-02-13 04:03:58,979 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => c7d7f715b522aafb4baaea641912f48a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:58,990 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:58,990 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 0560d2e09b5461c5d897c728ec0fb2e0, disabling compactions & flushes 2023-02-13 04:03:58,990 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:03:58,990 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:03:58,990 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. after waiting 0 ms 2023-02-13 04:03:58,990 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:03:58,990 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:03:58,991 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 0560d2e09b5461c5d897c728ec0fb2e0: Waiting for close lock at 1676261038990Disabling compacts and flushes for region at 1676261038990Disabling writes for close at 1676261038990Writing region close event to WAL at 1676261038990Closed at 1676261038990 2023-02-13 04:03:58,991 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3a9c07b23e5c3de2995af33ec5953d79, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:58,992 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:58,992 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 23600bfb9489de77511b8919349ae24b, disabling compactions & flushes 2023-02-13 04:03:58,992 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:03:58,992 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:03:58,992 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. after waiting 0 ms 2023-02-13 04:03:58,992 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:03:58,992 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:03:58,992 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 23600bfb9489de77511b8919349ae24b: Waiting for close lock at 1676261038992Disabling compacts and flushes for region at 1676261038992Disabling writes for close at 1676261038992Writing region close event to WAL at 1676261038992Closed at 1676261038992 2023-02-13 04:03:58,993 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 902e265a9f837f8af40e96b35cfc9f67, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:58,994 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39049,DS-b0ca2572-c66e-4478-aacf-40a8746c54d0,DISK] 2023-02-13 04:03:58,994 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46247,DS-7305340d-6d4f-46ee-92cc-73fd6231a63d,DISK] 2023-02-13 04:03:59,002 INFO [RS:0;jenkins-hbase4:41381] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/WALs/jenkins-hbase4.apache.org,41381,1676261037649/jenkins-hbase4.apache.org%2C41381%2C1676261037649.1676261038979 2023-02-13 04:03:59,005 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,005 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing c7d7f715b522aafb4baaea641912f48a, disabling compactions & flushes 2023-02-13 04:03:59,005 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:03:59,005 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:03:59,005 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. after waiting 0 ms 2023-02-13 04:03:59,005 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:03:59,005 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:03:59,005 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for c7d7f715b522aafb4baaea641912f48a: Waiting for close lock at 1676261039005Disabling compacts and flushes for region at 1676261039005Disabling writes for close at 1676261039005Writing region close event to WAL at 1676261039005Closed at 1676261039005 2023-02-13 04:03:59,005 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5e339c1446ecfe4a1580a9251f12d5ef, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:59,006 DEBUG [RS:0;jenkins-hbase4:41381] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39049,DS-b0ca2572-c66e-4478-aacf-40a8746c54d0,DISK], DatanodeInfoWithStorage[127.0.0.1:46247,DS-7305340d-6d4f-46ee-92cc-73fd6231a63d,DISK]] 2023-02-13 04:03:59,006 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,007 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 3a9c07b23e5c3de2995af33ec5953d79, disabling compactions & flushes 2023-02-13 04:03:59,007 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:03:59,007 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:03:59,007 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. after waiting 0 ms 2023-02-13 04:03:59,007 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:03:59,007 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:03:59,007 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 3a9c07b23e5c3de2995af33ec5953d79: Waiting for close lock at 1676261039007Disabling compacts and flushes for region at 1676261039007Disabling writes for close at 1676261039007Writing region close event to WAL at 1676261039007Closed at 1676261039007 2023-02-13 04:03:59,007 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 12b5f46153081cbbe23dc6da7d51da12, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:59,022 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,022 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 902e265a9f837f8af40e96b35cfc9f67, disabling compactions & flushes 2023-02-13 04:03:59,022 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:03:59,023 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:03:59,023 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. after waiting 0 ms 2023-02-13 04:03:59,023 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:03:59,023 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:03:59,023 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 902e265a9f837f8af40e96b35cfc9f67: Waiting for close lock at 1676261039022Disabling compacts and flushes for region at 1676261039022Disabling writes for close at 1676261039023 (+1 ms)Writing region close event to WAL at 1676261039023Closed at 1676261039023 2023-02-13 04:03:59,023 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 11582139dfb10d92dc5b9f056cb10216, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp 2023-02-13 04:03:59,027 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:59,027 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 5e339c1446ecfe4a1580a9251f12d5ef, disabling compactions & flushes 2023-02-13 04:03:59,027 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,028 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:03:59,028 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 12b5f46153081cbbe23dc6da7d51da12, disabling compactions & flushes 2023-02-13 04:03:59,028 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:03:59,028 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:03:59,028 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:03:59,028 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. after waiting 0 ms 2023-02-13 04:03:59,028 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. after waiting 0 ms 2023-02-13 04:03:59,028 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:03:59,028 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:03:59,028 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:03:59,028 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:03:59,028 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 12b5f46153081cbbe23dc6da7d51da12: Waiting for close lock at 1676261039028Disabling compacts and flushes for region at 1676261039028Disabling writes for close at 1676261039028Writing region close event to WAL at 1676261039028Closed at 1676261039028 2023-02-13 04:03:59,028 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 5e339c1446ecfe4a1580a9251f12d5ef: Waiting for close lock at 1676261039027Disabling compacts and flushes for region at 1676261039027Disabling writes for close at 1676261039028 (+1 ms)Writing region close event to WAL at 1676261039028Closed at 1676261039028 2023-02-13 04:03:59,032 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,032 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 11582139dfb10d92dc5b9f056cb10216, disabling compactions & flushes 2023-02-13 04:03:59,032 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:03:59,032 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:03:59,032 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. after waiting 0 ms 2023-02-13 04:03:59,032 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:03:59,032 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:03:59,032 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 11582139dfb10d92dc5b9f056cb10216: Waiting for close lock at 1676261039032Disabling compacts and flushes for region at 1676261039032Disabling writes for close at 1676261039032Writing region close event to WAL at 1676261039032Closed at 1676261039032 2023-02-13 04:03:59,034 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:03:59,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676261038920.81c803a453213180a0941d1de82923f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261039034"}]},"ts":"1676261039034"} 2023-02-13 04:03:59,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676261039034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261039034"}]},"ts":"1676261039034"} 2023-02-13 04:03:59,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261039034"}]},"ts":"1676261039034"} 2023-02-13 04:03:59,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261039034"}]},"ts":"1676261039034"} 2023-02-13 04:03:59,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261039034"}]},"ts":"1676261039034"} 2023-02-13 04:03:59,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261039034"}]},"ts":"1676261039034"} 2023-02-13 04:03:59,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261039034"}]},"ts":"1676261039034"} 2023-02-13 04:03:59,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261039034"}]},"ts":"1676261039034"} 2023-02-13 04:03:59,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261039034"}]},"ts":"1676261039034"} 2023-02-13 04:03:59,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676261039034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261039034"}]},"ts":"1676261039034"} 2023-02-13 04:03:59,037 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 04:03:59,038 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:03:59,038 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261039038"}]},"ts":"1676261039038"} 2023-02-13 04:03:59,039 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-13 04:03:59,043 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:03:59,048 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:03:59,048 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:03:59,048 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:03:59,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84863e66b3da719eb4cb244e7c2cb3b2, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0560d2e09b5461c5d897c728ec0fb2e0, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81c803a453213180a0941d1de82923f8, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=23600bfb9489de77511b8919349ae24b, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7d7f715b522aafb4baaea641912f48a, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a9c07b23e5c3de2995af33ec5953d79, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=902e265a9f837f8af40e96b35cfc9f67, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e339c1446ecfe4a1580a9251f12d5ef, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12b5f46153081cbbe23dc6da7d51da12, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=11582139dfb10d92dc5b9f056cb10216, ASSIGN}] 2023-02-13 04:03:59,051 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0560d2e09b5461c5d897c728ec0fb2e0, ASSIGN 2023-02-13 04:03:59,051 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e339c1446ecfe4a1580a9251f12d5ef, ASSIGN 2023-02-13 04:03:59,051 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84863e66b3da719eb4cb244e7c2cb3b2, ASSIGN 2023-02-13 04:03:59,051 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12b5f46153081cbbe23dc6da7d51da12, ASSIGN 2023-02-13 04:03:59,051 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0560d2e09b5461c5d897c728ec0fb2e0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39517,1676261037674; forceNewPlan=false, retain=false 2023-02-13 04:03:59,051 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=11582139dfb10d92dc5b9f056cb10216, ASSIGN 2023-02-13 04:03:59,051 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e339c1446ecfe4a1580a9251f12d5ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39517,1676261037674; forceNewPlan=false, retain=false 2023-02-13 04:03:59,051 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12b5f46153081cbbe23dc6da7d51da12, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41381,1676261037649; forceNewPlan=false, retain=false 2023-02-13 04:03:59,051 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84863e66b3da719eb4cb244e7c2cb3b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41381,1676261037649; forceNewPlan=false, retain=false 2023-02-13 04:03:59,052 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=902e265a9f837f8af40e96b35cfc9f67, ASSIGN 2023-02-13 04:03:59,052 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=11582139dfb10d92dc5b9f056cb10216, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41381,1676261037649; forceNewPlan=false, retain=false 2023-02-13 04:03:59,052 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a9c07b23e5c3de2995af33ec5953d79, ASSIGN 2023-02-13 04:03:59,052 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7d7f715b522aafb4baaea641912f48a, ASSIGN 2023-02-13 04:03:59,053 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=23600bfb9489de77511b8919349ae24b, ASSIGN 2023-02-13 04:03:59,053 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=902e265a9f837f8af40e96b35cfc9f67, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39517,1676261037674; forceNewPlan=false, retain=false 2023-02-13 04:03:59,053 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81c803a453213180a0941d1de82923f8, ASSIGN 2023-02-13 04:03:59,053 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a9c07b23e5c3de2995af33ec5953d79, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41381,1676261037649; forceNewPlan=false, retain=false 2023-02-13 04:03:59,053 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7d7f715b522aafb4baaea641912f48a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39517,1676261037674; forceNewPlan=false, retain=false 2023-02-13 04:03:59,054 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=23600bfb9489de77511b8919349ae24b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41381,1676261037649; forceNewPlan=false, retain=false 2023-02-13 04:03:59,054 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81c803a453213180a0941d1de82923f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39517,1676261037674; forceNewPlan=false, retain=false 2023-02-13 04:03:59,202 INFO [jenkins-hbase4:42999] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 04:03:59,208 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=11582139dfb10d92dc5b9f056cb10216, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,208 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=12b5f46153081cbbe23dc6da7d51da12, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,208 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=84863e66b3da719eb4cb244e7c2cb3b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,208 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=23600bfb9489de77511b8919349ae24b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,208 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676261039208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261039208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261039208"}]},"ts":"1676261039208"} 2023-02-13 04:03:59,208 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3a9c07b23e5c3de2995af33ec5953d79, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,208 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261039208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261039208"}]},"ts":"1676261039208"} 2023-02-13 04:03:59,208 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261039208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261039208"}]},"ts":"1676261039208"} 2023-02-13 04:03:59,208 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261039208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261039208"}]},"ts":"1676261039208"} 2023-02-13 04:03:59,208 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676261039208"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261039208"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261039208"}]},"ts":"1676261039208"} 2023-02-13 04:03:59,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=11, state=RUNNABLE; OpenRegionProcedure 84863e66b3da719eb4cb244e7c2cb3b2, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:03:59,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 3a9c07b23e5c3de2995af33ec5953d79, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:03:59,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=14, state=RUNNABLE; OpenRegionProcedure 23600bfb9489de77511b8919349ae24b, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:03:59,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=19, state=RUNNABLE; OpenRegionProcedure 12b5f46153081cbbe23dc6da7d51da12, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:03:59,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 11582139dfb10d92dc5b9f056cb10216, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:03:59,213 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c7d7f715b522aafb4baaea641912f48a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,213 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039213"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261039213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261039213"}]},"ts":"1676261039213"} 2023-02-13 04:03:59,213 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=0560d2e09b5461c5d897c728ec0fb2e0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,213 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039213"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261039213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261039213"}]},"ts":"1676261039213"} 2023-02-13 04:03:59,214 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=5e339c1446ecfe4a1580a9251f12d5ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,214 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039214"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261039214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261039214"}]},"ts":"1676261039214"} 2023-02-13 04:03:59,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure c7d7f715b522aafb4baaea641912f48a, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:03:59,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure 0560d2e09b5461c5d897c728ec0fb2e0, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:03:59,216 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=81c803a453213180a0941d1de82923f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,216 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676261038920.81c803a453213180a0941d1de82923f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039216"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261039216"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261039216"}]},"ts":"1676261039216"} 2023-02-13 04:03:59,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 5e339c1446ecfe4a1580a9251f12d5ef, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:03:59,217 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=902e265a9f837f8af40e96b35cfc9f67, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure 81c803a453213180a0941d1de82923f8, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:03:59,217 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039217"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261039217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261039217"}]},"ts":"1676261039217"} 2023-02-13 04:03:59,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure 902e265a9f837f8af40e96b35cfc9f67, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:03:59,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:59,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:03:59,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3a9c07b23e5c3de2995af33ec5953d79, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 04:03:59,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:03:59,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:03:59,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:03:59,369 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:03:59,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:03:59,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 902e265a9f837f8af40e96b35cfc9f67, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 04:03:59,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:03:59,371 DEBUG [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1 2023-02-13 04:03:59,371 DEBUG [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1 2023-02-13 04:03:59,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:03:59,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:03:59,371 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a9c07b23e5c3de2995af33ec5953d79 columnFamilyName f1 2023-02-13 04:03:59,372 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] regionserver.HStore(310): Store=3a9c07b23e5c3de2995af33ec5953d79/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,372 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:03:59,372 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:03:59,373 DEBUG [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1 2023-02-13 04:03:59,373 DEBUG [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1 2023-02-13 04:03:59,373 DEBUG [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2 2023-02-13 04:03:59,374 DEBUG [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2 2023-02-13 04:03:59,374 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 902e265a9f837f8af40e96b35cfc9f67 columnFamilyName f1 2023-02-13 04:03:59,374 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a9c07b23e5c3de2995af33ec5953d79 columnFamilyName f2 2023-02-13 04:03:59,374 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] regionserver.HStore(310): Store=902e265a9f837f8af40e96b35cfc9f67/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,374 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] regionserver.HStore(310): Store=3a9c07b23e5c3de2995af33ec5953d79/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,374 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:03:59,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:03:59,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:03:59,376 DEBUG [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2 2023-02-13 04:03:59,376 DEBUG [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2 2023-02-13 04:03:59,376 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 902e265a9f837f8af40e96b35cfc9f67 columnFamilyName f2 2023-02-13 04:03:59,377 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] regionserver.HStore(310): Store=902e265a9f837f8af40e96b35cfc9f67/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:03:59,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:03:59,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:59,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:03:59,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:59,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:03:59,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:59,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3a9c07b23e5c3de2995af33ec5953d79; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63094481, jitterRate=-0.059818968176841736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:59,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3a9c07b23e5c3de2995af33ec5953d79: Running coprocessor pre-open hook at 1676261039368Writing region info on filesystem at 1676261039368Initializing all the Stores at 1676261039369 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039369Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039369Cleaning up temporary data from old regions at 1676261039377 (+8 ms)Cleaning up detritus from prior splits at 1676261039377Running coprocessor post-open hooks at 1676261039382 (+5 ms)Region opened successfully at 1676261039382 2023-02-13 04:03:59,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79., pid=22, masterSystemTime=1676261039361 2023-02-13 04:03:59,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:59,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 902e265a9f837f8af40e96b35cfc9f67; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61813984, jitterRate=-0.07889986038208008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:59,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 902e265a9f837f8af40e96b35cfc9f67: Running coprocessor pre-open hook at 1676261039371Writing region info on filesystem at 1676261039371Initializing all the Stores at 1676261039372 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039372Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039372Cleaning up temporary data from old regions at 1676261039378 (+6 ms)Cleaning up detritus from prior splits at 1676261039379 (+1 ms)Running coprocessor post-open hooks at 1676261039383 (+4 ms)Region opened successfully at 1676261039383 2023-02-13 04:03:59,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67., pid=30, masterSystemTime=1676261039367 2023-02-13 04:03:59,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:03:59,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:03:59,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:03:59,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 84863e66b3da719eb4cb244e7c2cb3b2, NAME => 'testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 04:03:59,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:03:59,384 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3a9c07b23e5c3de2995af33ec5953d79, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:03:59,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:03:59,385 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039384"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261039384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261039384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261039384"}]},"ts":"1676261039384"} 2023-02-13 04:03:59,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:03:59,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:03:59,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:03:59,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c7d7f715b522aafb4baaea641912f48a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 04:03:59,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=902e265a9f837f8af40e96b35cfc9f67, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:03:59,385 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039385"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261039385"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261039385"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261039385"}]},"ts":"1676261039385"} 2023-02-13 04:03:59,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:03:59,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:03:59,386 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:03:59,387 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:03:59,388 DEBUG [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/f1 2023-02-13 04:03:59,388 DEBUG [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/f1 2023-02-13 04:03:59,389 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84863e66b3da719eb4cb244e7c2cb3b2 columnFamilyName f1 2023-02-13 04:03:59,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-13 04:03:59,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-13 04:03:59,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure 902e265a9f837f8af40e96b35cfc9f67, server=jenkins-hbase4.apache.org,39517,1676261037674 in 169 msec 2023-02-13 04:03:59,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 3a9c07b23e5c3de2995af33ec5953d79, server=jenkins-hbase4.apache.org,41381,1676261037649 in 177 msec 2023-02-13 04:03:59,389 DEBUG [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1 2023-02-13 04:03:59,389 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] regionserver.HStore(310): Store=84863e66b3da719eb4cb244e7c2cb3b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,389 DEBUG [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1 2023-02-13 04:03:59,390 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:03:59,390 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7d7f715b522aafb4baaea641912f48a columnFamilyName f1 2023-02-13 04:03:59,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a9c07b23e5c3de2995af33ec5953d79, ASSIGN in 340 msec 2023-02-13 04:03:59,390 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] regionserver.HStore(310): Store=c7d7f715b522aafb4baaea641912f48a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=902e265a9f837f8af40e96b35cfc9f67, ASSIGN in 340 msec 2023-02-13 04:03:59,391 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:03:59,391 DEBUG [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/f2 2023-02-13 04:03:59,391 DEBUG [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/f2 2023-02-13 04:03:59,392 DEBUG [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2 2023-02-13 04:03:59,392 DEBUG [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2 2023-02-13 04:03:59,392 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84863e66b3da719eb4cb244e7c2cb3b2 columnFamilyName f2 2023-02-13 04:03:59,392 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7d7f715b522aafb4baaea641912f48a columnFamilyName f2 2023-02-13 04:03:59,392 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] regionserver.HStore(310): Store=c7d7f715b522aafb4baaea641912f48a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,392 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] regionserver.HStore(310): Store=84863e66b3da719eb4cb244e7c2cb3b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:03:59,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:03:59,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:03:59,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:03:59,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:59,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:59,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:03:59,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:03:59,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:59,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:59,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 84863e66b3da719eb4cb244e7c2cb3b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61899063, jitterRate=-0.07763208448886871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:59,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 84863e66b3da719eb4cb244e7c2cb3b2: Running coprocessor pre-open hook at 1676261039385Writing region info on filesystem at 1676261039385Initializing all the Stores at 1676261039386 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039386Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039386Cleaning up temporary data from old regions at 1676261039394 (+8 ms)Cleaning up detritus from prior splits at 1676261039395 (+1 ms)Running coprocessor post-open hooks at 1676261039399 (+4 ms)Region opened successfully at 1676261039399 2023-02-13 04:03:59,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c7d7f715b522aafb4baaea641912f48a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60123300, jitterRate=-0.10409301519393921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:59,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c7d7f715b522aafb4baaea641912f48a: Running coprocessor pre-open hook at 1676261039386Writing region info on filesystem at 1676261039386Initializing all the Stores at 1676261039387 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039387Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039387Cleaning up temporary data from old regions at 1676261039394 (+7 ms)Cleaning up detritus from prior splits at 1676261039395 (+1 ms)Running coprocessor post-open hooks at 1676261039399 (+4 ms)Region opened successfully at 1676261039399 2023-02-13 04:03:59,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a., pid=26, masterSystemTime=1676261039367 2023-02-13 04:03:59,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2., pid=21, masterSystemTime=1676261039361 2023-02-13 04:03:59,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:03:59,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:03:59,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:03:59,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5e339c1446ecfe4a1580a9251f12d5ef, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 04:03:59,402 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c7d7f715b522aafb4baaea641912f48a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:03:59,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,403 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039402"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261039402"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261039402"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261039402"}]},"ts":"1676261039402"} 2023-02-13 04:03:59,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:03:59,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:03:59,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:03:59,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:03:59,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:03:59,404 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:03:59,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 12b5f46153081cbbe23dc6da7d51da12, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 04:03:59,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:03:59,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:03:59,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:03:59,405 DEBUG [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1 2023-02-13 04:03:59,406 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:03:59,406 DEBUG [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1 2023-02-13 04:03:59,406 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=84863e66b3da719eb4cb244e7c2cb3b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,406 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676261039405"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261039405"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261039405"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261039405"}]},"ts":"1676261039405"} 2023-02-13 04:03:59,406 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e339c1446ecfe4a1580a9251f12d5ef columnFamilyName f1 2023-02-13 04:03:59,406 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] regionserver.HStore(310): Store=5e339c1446ecfe4a1580a9251f12d5ef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,407 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:03:59,407 DEBUG [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1 2023-02-13 04:03:59,407 DEBUG [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1 2023-02-13 04:03:59,407 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12b5f46153081cbbe23dc6da7d51da12 columnFamilyName f1 2023-02-13 04:03:59,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-13 04:03:59,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure c7d7f715b522aafb4baaea641912f48a, server=jenkins-hbase4.apache.org,39517,1676261037674 in 191 msec 2023-02-13 04:03:59,408 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] regionserver.HStore(310): Store=12b5f46153081cbbe23dc6da7d51da12/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,408 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:03:59,408 DEBUG [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2 2023-02-13 04:03:59,408 DEBUG [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2 2023-02-13 04:03:59,408 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e339c1446ecfe4a1580a9251f12d5ef columnFamilyName f2 2023-02-13 04:03:59,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7d7f715b522aafb4baaea641912f48a, ASSIGN in 358 msec 2023-02-13 04:03:59,409 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] regionserver.HStore(310): Store=5e339c1446ecfe4a1580a9251f12d5ef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,409 DEBUG [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2 2023-02-13 04:03:59,409 DEBUG [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2 2023-02-13 04:03:59,409 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=11 2023-02-13 04:03:59,409 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=11, state=SUCCESS; OpenRegionProcedure 84863e66b3da719eb4cb244e7c2cb3b2, server=jenkins-hbase4.apache.org,41381,1676261037649 in 197 msec 2023-02-13 04:03:59,409 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12b5f46153081cbbe23dc6da7d51da12 columnFamilyName f2 2023-02-13 04:03:59,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:03:59,410 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] regionserver.HStore(310): Store=12b5f46153081cbbe23dc6da7d51da12/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:03:59,410 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84863e66b3da719eb4cb244e7c2cb3b2, ASSIGN in 360 msec 2023-02-13 04:03:59,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:03:59,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:03:59,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:59,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:03:59,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:59,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:03:59,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:59,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5e339c1446ecfe4a1580a9251f12d5ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69794067, jitterRate=0.04001264274120331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:59,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5e339c1446ecfe4a1580a9251f12d5ef: Running coprocessor pre-open hook at 1676261039403Writing region info on filesystem at 1676261039403Initializing all the Stores at 1676261039404 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039404Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039404Cleaning up temporary data from old regions at 1676261039411 (+7 ms)Cleaning up detritus from prior splits at 1676261039411Running coprocessor post-open hooks at 1676261039415 (+4 ms)Region opened successfully at 1676261039415 2023-02-13 04:03:59,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:59,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef., pid=28, masterSystemTime=1676261039367 2023-02-13 04:03:59,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 12b5f46153081cbbe23dc6da7d51da12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74513045, jitterRate=0.11033089458942413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:59,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 12b5f46153081cbbe23dc6da7d51da12: Running coprocessor pre-open hook at 1676261039405Writing region info on filesystem at 1676261039405Initializing all the Stores at 1676261039405Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039405Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039405Cleaning up temporary data from old regions at 1676261039412 (+7 ms)Cleaning up detritus from prior splits at 1676261039412Running coprocessor post-open hooks at 1676261039416 (+4 ms)Region opened successfully at 1676261039416 2023-02-13 04:03:59,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12., pid=24, masterSystemTime=1676261039361 2023-02-13 04:03:59,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:03:59,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:03:59,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:03:59,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 81c803a453213180a0941d1de82923f8, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 04:03:59,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 81c803a453213180a0941d1de82923f8 2023-02-13 04:03:59,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 81c803a453213180a0941d1de82923f8 2023-02-13 04:03:59,418 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=5e339c1446ecfe4a1580a9251f12d5ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 81c803a453213180a0941d1de82923f8 2023-02-13 04:03:59,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039418"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261039418"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261039418"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261039418"}]},"ts":"1676261039418"} 2023-02-13 04:03:59,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:03:59,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:03:59,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:03:59,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 23600bfb9489de77511b8919349ae24b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 04:03:59,419 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=12b5f46153081cbbe23dc6da7d51da12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 23600bfb9489de77511b8919349ae24b 2023-02-13 04:03:59,419 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039419"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261039419"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261039419"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261039419"}]},"ts":"1676261039419"} 2023-02-13 04:03:59,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 23600bfb9489de77511b8919349ae24b 2023-02-13 04:03:59,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 23600bfb9489de77511b8919349ae24b 2023-02-13 04:03:59,420 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81c803a453213180a0941d1de82923f8 2023-02-13 04:03:59,422 DEBUG [StoreOpener-81c803a453213180a0941d1de82923f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1 2023-02-13 04:03:59,422 DEBUG [StoreOpener-81c803a453213180a0941d1de82923f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1 2023-02-13 04:03:59,423 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81c803a453213180a0941d1de82923f8 columnFamilyName f1 2023-02-13 04:03:59,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-13 04:03:59,423 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=19 2023-02-13 04:03:59,424 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 23600bfb9489de77511b8919349ae24b 2023-02-13 04:03:59,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 5e339c1446ecfe4a1580a9251f12d5ef, server=jenkins-hbase4.apache.org,39517,1676261037674 in 204 msec 2023-02-13 04:03:59,424 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] regionserver.HStore(310): Store=81c803a453213180a0941d1de82923f8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=19, state=SUCCESS; OpenRegionProcedure 12b5f46153081cbbe23dc6da7d51da12, server=jenkins-hbase4.apache.org,41381,1676261037649 in 209 msec 2023-02-13 04:03:59,424 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81c803a453213180a0941d1de82923f8 2023-02-13 04:03:59,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e339c1446ecfe4a1580a9251f12d5ef, ASSIGN in 375 msec 2023-02-13 04:03:59,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12b5f46153081cbbe23dc6da7d51da12, ASSIGN in 375 msec 2023-02-13 04:03:59,426 DEBUG [StoreOpener-23600bfb9489de77511b8919349ae24b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1 2023-02-13 04:03:59,426 DEBUG [StoreOpener-23600bfb9489de77511b8919349ae24b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1 2023-02-13 04:03:59,426 DEBUG [StoreOpener-81c803a453213180a0941d1de82923f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2 2023-02-13 04:03:59,426 DEBUG [StoreOpener-81c803a453213180a0941d1de82923f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2 2023-02-13 04:03:59,427 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23600bfb9489de77511b8919349ae24b columnFamilyName f1 2023-02-13 04:03:59,427 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81c803a453213180a0941d1de82923f8 columnFamilyName f2 2023-02-13 04:03:59,427 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] regionserver.HStore(310): Store=23600bfb9489de77511b8919349ae24b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,427 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] regionserver.HStore(310): Store=81c803a453213180a0941d1de82923f8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,427 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 23600bfb9489de77511b8919349ae24b 2023-02-13 04:03:59,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8 2023-02-13 04:03:59,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8 2023-02-13 04:03:59,429 DEBUG [StoreOpener-23600bfb9489de77511b8919349ae24b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2 2023-02-13 04:03:59,429 DEBUG [StoreOpener-23600bfb9489de77511b8919349ae24b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2 2023-02-13 04:03:59,429 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23600bfb9489de77511b8919349ae24b columnFamilyName f2 2023-02-13 04:03:59,429 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] regionserver.HStore(310): Store=23600bfb9489de77511b8919349ae24b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:59,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b 2023-02-13 04:03:59,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b 2023-02-13 04:03:59,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 81c803a453213180a0941d1de82923f8 2023-02-13 04:03:59,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:59,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:59,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 23600bfb9489de77511b8919349ae24b 2023-02-13 04:03:59,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 81c803a453213180a0941d1de82923f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70331779, jitterRate=0.04802517592906952}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:59,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 81c803a453213180a0941d1de82923f8: Running coprocessor pre-open hook at 1676261039418Writing region info on filesystem at 1676261039418Initializing all the Stores at 1676261039420 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039420Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039420Cleaning up temporary data from old regions at 1676261039429 (+9 ms)Cleaning up detritus from prior splits at 1676261039429Running coprocessor post-open hooks at 1676261039433 (+4 ms)Region opened successfully at 1676261039433 2023-02-13 04:03:59,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8., pid=29, masterSystemTime=1676261039367 2023-02-13 04:03:59,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:59,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 23600bfb9489de77511b8919349ae24b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71608541, jitterRate=0.06705041229724884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:59,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 23600bfb9489de77511b8919349ae24b: Running coprocessor pre-open hook at 1676261039420Writing region info on filesystem at 1676261039420Initializing all the Stores at 1676261039422 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039422Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039423 (+1 ms)Cleaning up temporary data from old regions at 1676261039431 (+8 ms)Cleaning up detritus from prior splits at 1676261039431Running coprocessor post-open hooks at 1676261039436 (+5 ms)Region opened successfully at 1676261039436 2023-02-13 04:03:59,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b., pid=23, masterSystemTime=1676261039361 2023-02-13 04:03:59,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:03:59,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:03:59,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:03:59,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0560d2e09b5461c5d897c728ec0fb2e0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 04:03:59,439 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=81c803a453213180a0941d1de82923f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:03:59,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,439 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676261038920.81c803a453213180a0941d1de82923f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039439"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261039439"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261039439"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261039439"}]},"ts":"1676261039439"} 2023-02-13 04:03:59,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:03:59,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:03:59,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:03:59,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:03:59,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:03:59,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 11582139dfb10d92dc5b9f056cb10216, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 04:03:59,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:03:59,441 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=23600bfb9489de77511b8919349ae24b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:03:59,441 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039440"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261039440"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261039440"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261039440"}]},"ts":"1676261039440"} 2023-02-13 04:03:59,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:03:59,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:03:59,442 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:03:59,443 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:03:59,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-13 04:03:59,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure 81c803a453213180a0941d1de82923f8, server=jenkins-hbase4.apache.org,39517,1676261037674 in 224 msec 2023-02-13 04:03:59,444 DEBUG [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1 2023-02-13 04:03:59,444 DEBUG [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1 2023-02-13 04:03:59,445 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0560d2e09b5461c5d897c728ec0fb2e0 columnFamilyName f1 2023-02-13 04:03:59,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=14 2023-02-13 04:03:59,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=14, state=SUCCESS; OpenRegionProcedure 23600bfb9489de77511b8919349ae24b, server=jenkins-hbase4.apache.org,41381,1676261037649 in 231 msec 2023-02-13 04:03:59,445 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] regionserver.HStore(310): Store=0560d2e09b5461c5d897c728ec0fb2e0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,445 DEBUG [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/f1 2023-02-13 04:03:59,445 DEBUG [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/f1 2023-02-13 04:03:59,445 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:03:59,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81c803a453213180a0941d1de82923f8, ASSIGN in 395 msec 2023-02-13 04:03:59,446 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11582139dfb10d92dc5b9f056cb10216 columnFamilyName f1 2023-02-13 04:03:59,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=23600bfb9489de77511b8919349ae24b, ASSIGN in 396 msec 2023-02-13 04:03:59,446 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] regionserver.HStore(310): Store=11582139dfb10d92dc5b9f056cb10216/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,447 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:03:59,447 DEBUG [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2 2023-02-13 04:03:59,447 DEBUG [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2 2023-02-13 04:03:59,447 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0560d2e09b5461c5d897c728ec0fb2e0 columnFamilyName f2 2023-02-13 04:03:59,448 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] regionserver.HStore(310): Store=0560d2e09b5461c5d897c728ec0fb2e0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,448 DEBUG [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/f2 2023-02-13 04:03:59,448 DEBUG [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/f2 2023-02-13 04:03:59,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:03:59,449 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11582139dfb10d92dc5b9f056cb10216 columnFamilyName f2 2023-02-13 04:03:59,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:03:59,449 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] regionserver.HStore(310): Store=11582139dfb10d92dc5b9f056cb10216/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:03:59,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:03:59,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:03:59,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:59,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:03:59,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:03:59,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:03:59,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:59,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0560d2e09b5461c5d897c728ec0fb2e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74659876, jitterRate=0.11251884698867798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:59,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0560d2e09b5461c5d897c728ec0fb2e0: Running coprocessor pre-open hook at 1676261039440Writing region info on filesystem at 1676261039440Initializing all the Stores at 1676261039441 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039441Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039441Cleaning up temporary data from old regions at 1676261039450 (+9 ms)Cleaning up detritus from prior splits at 1676261039451 (+1 ms)Running coprocessor post-open hooks at 1676261039456 (+5 ms)Region opened successfully at 1676261039456 2023-02-13 04:03:59,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:03:59,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 11582139dfb10d92dc5b9f056cb10216; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74423974, jitterRate=0.10900363326072693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:03:59,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0., pid=27, masterSystemTime=1676261039367 2023-02-13 04:03:59,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 11582139dfb10d92dc5b9f056cb10216: Running coprocessor pre-open hook at 1676261039441Writing region info on filesystem at 1676261039441Initializing all the Stores at 1676261039443 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039443Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261039443Cleaning up temporary data from old regions at 1676261039452 (+9 ms)Cleaning up detritus from prior splits at 1676261039452Running coprocessor post-open hooks at 1676261039457 (+5 ms)Region opened successfully at 1676261039457 2023-02-13 04:03:59,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216., pid=25, masterSystemTime=1676261039361 2023-02-13 04:03:59,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:03:59,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:03:59,459 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=0560d2e09b5461c5d897c728ec0fb2e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,459 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261039459"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261039459"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261039459"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261039459"}]},"ts":"1676261039459"} 2023-02-13 04:03:59,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:03:59,460 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=11582139dfb10d92dc5b9f056cb10216, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:03:59,460 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676261039460"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261039460"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261039460"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261039460"}]},"ts":"1676261039460"} 2023-02-13 04:03:59,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-13 04:03:59,463 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure 0560d2e09b5461c5d897c728ec0fb2e0, server=jenkins-hbase4.apache.org,39517,1676261037674 in 246 msec 2023-02-13 04:03:59,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-13 04:03:59,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 11582139dfb10d92dc5b9f056cb10216, server=jenkins-hbase4.apache.org,41381,1676261037649 in 249 msec 2023-02-13 04:03:59,465 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0560d2e09b5461c5d897c728ec0fb2e0, ASSIGN in 414 msec 2023-02-13 04:03:59,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-13 04:03:59,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=11582139dfb10d92dc5b9f056cb10216, ASSIGN in 415 msec 2023-02-13 04:03:59,467 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:03:59,467 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261039467"}]},"ts":"1676261039467"} 2023-02-13 04:03:59,468 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-13 04:03:59,470 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:03:59,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 549 msec 2023-02-13 04:03:59,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:03:59,531 INFO [Listener at localhost/36569] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-13 04:03:59,532 DEBUG [Listener at localhost/36569] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-13 04:03:59,532 INFO [Listener at localhost/36569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:03:59,534 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-13 04:03:59,534 INFO [Listener at localhost/36569] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:03:59,534 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-13 04:03:59,534 INFO [Listener at localhost/36569] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 04:03:59,572 DEBUG [hconnection-0x58ce421d-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:59,643 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49314, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:59,647 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41381] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:03:59,656 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39517] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:03:59,733 INFO [Listener at localhost/36569] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 04:03:59,734 INFO [Listener at localhost/36569] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 04:03:59,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 04:03:59,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676261039735 (current time:1676261039735). 2023-02-13 04:03:59,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 04:03:59,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] zookeeper.ReadOnlyZKClient(139): Connect 0x1273c703 to 127.0.0.1:63217 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:03:59,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34d4c77c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:03:59,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:03:59,744 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54126, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:03:59,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1273c703 to 127.0.0.1:63217 2023-02-13 04:03:59,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:03:59,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 04:03:59,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 04:03:59,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 04:03:59,749 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 04:03:59,750 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676261639750 2023-02-13 04:03:59,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 04:03:59,750 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,752 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 04:03:59,752 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 04:03:59,753 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 04:03:59,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 04:03:59,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-13 04:03:59,754 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 04:03:59,755 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676261639755 2023-02-13 04:03:59,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,772 INFO [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-13 04:03:59,772 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:59,773 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-13 04:03:59,773 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 04:03:59,774 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,774 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,776 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:59,776 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:03:59,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:59,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:59,776 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:03:59,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:03:59,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,776 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,777 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,777 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,777 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:03:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-13 04:03:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-13 04:03:59,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,777 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-13 04:03:59,777 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-13 04:03:59,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,778 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-13 04:03:59,778 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:59,778 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-13 04:03:59,781 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 04:03:59,781 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 04:03:59,781 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:03:59,781 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41381,1676261037649' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 04:03:59,781 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 04:03:59,781 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 04:03:59,781 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39517,1676261037674' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 04:03:59,782 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,782 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,782 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,783 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:59,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:59,783 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:59,783 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:59,783 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,783 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:03:59,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:59,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:59,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39517,1676261037674' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 04:03:59,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@511e29e5[Count = 1] remaining members to acquire global barrier 2023-02-13 04:03:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:03:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:03:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:03:59,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:03:59,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:03:59,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41381,1676261037649' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 04:03:59,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@511e29e5[Count = 0] remaining members to acquire global barrier 2023-02-13 04:03:59,787 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 04:03:59,787 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,788 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,788 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,788 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 04:03:59,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,788 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:03:59,788 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 04:03:59,789 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:03:59,789 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:03:59,789 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. started... 2023-02-13 04:03:59,789 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. started... 2023-02-13 04:03:59,789 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:03:59,789 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:03:59,793 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:03:59,793 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 902e265a9f837f8af40e96b35cfc9f67 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:59,793 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 04:03:59,793 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:03:59,793 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. started... 2023-02-13 04:03:59,793 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3a9c07b23e5c3de2995af33ec5953d79 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:59,793 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 04:03:59,794 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:03:59,794 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:03:59,794 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 12b5f46153081cbbe23dc6da7d51da12 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 04:03:59,793 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:03:59,794 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. started... 2023-02-13 04:03:59,793 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:03:59,795 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c7d7f715b522aafb4baaea641912f48a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:59,795 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. started... 2023-02-13 04:03:59,794 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. started... 2023-02-13 04:03:59,797 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 11582139dfb10d92dc5b9f056cb10216: 2023-02-13 04:03:59,797 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 81c803a453213180a0941d1de82923f8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:59,797 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,798 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:59,798 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:59,798 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:59,834 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/.tmp/f1/7eca6a2fb5a14391a2f313ba03a67ffd 2023-02-13 04:03:59,835 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. completed. 2023-02-13 04:03:59,835 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:03:59,835 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:03:59,835 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 04:03:59,835 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. started... 2023-02-13 04:03:59,841 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 84863e66b3da719eb4cb244e7c2cb3b2: 2023-02-13 04:03:59,841 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,841 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/.tmp/f1/54e2f0629e864a3b92414640a073c6bc 2023-02-13 04:03:59,841 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:59,841 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:59,841 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 04:03:59,843 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/.tmp/f1/c60d61e6262242fc84a3695c6f46af40 2023-02-13 04:03:59,853 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:03:59,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 04:03:59,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:03:59,855 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 04:03:59,857 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/.tmp/f1/a0ad40c35b0e409c85fd086b83848cec 2023-02-13 04:03:59,857 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/.tmp/f1/548368985bf8428baae1a0360eebff20 2023-02-13 04:03:59,878 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. completed. 2023-02-13 04:03:59,878 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:03:59,878 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:03:59,878 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 04:03:59,878 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. started... 2023-02-13 04:03:59,885 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 23600bfb9489de77511b8919349ae24b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:59,892 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/.tmp/f2/3769dfd8d46f4565829fa13f82b42f9c 2023-02-13 04:03:59,895 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/.tmp/f2/2fb0c4bf53ef4f0390222f2af1824d3d 2023-02-13 04:03:59,897 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/.tmp/f1/c60d61e6262242fc84a3695c6f46af40 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/c60d61e6262242fc84a3695c6f46af40 2023-02-13 04:03:59,902 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/c60d61e6262242fc84a3695c6f46af40, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:59,904 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/.tmp/f2/3769dfd8d46f4565829fa13f82b42f9c as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/3769dfd8d46f4565829fa13f82b42f9c 2023-02-13 04:03:59,909 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/3769dfd8d46f4565829fa13f82b42f9c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:59,910 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 81c803a453213180a0941d1de82923f8 in 113ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:59,910 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-13 04:03:59,910 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 81c803a453213180a0941d1de82923f8: 2023-02-13 04:03:59,911 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,913 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:59,913 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/c60d61e6262242fc84a3695c6f46af40] hfiles 2023-02-13 04:03:59,913 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/c60d61e6262242fc84a3695c6f46af40 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,913 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/3769dfd8d46f4565829fa13f82b42f9c] hfiles 2023-02-13 04:03:59,913 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/3769dfd8d46f4565829fa13f82b42f9c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,932 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/.tmp/f2/bf1c819bfe3a4b389dfc5b5b2c3f3ae0 2023-02-13 04:03:59,933 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/.tmp/f2/a8b8302554a3419c900a45b1307f1099 2023-02-13 04:03:59,936 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/.tmp/f1/e28b427b921f4bebb82a3fd166626bf8 2023-02-13 04:03:59,937 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/.tmp/f1/7eca6a2fb5a14391a2f313ba03a67ffd as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/7eca6a2fb5a14391a2f313ba03a67ffd 2023-02-13 04:03:59,937 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/.tmp/f2/3ffc804d7ad0424c9f2dfe088b835333 2023-02-13 04:03:59,941 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/.tmp/f1/548368985bf8428baae1a0360eebff20 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/548368985bf8428baae1a0360eebff20 2023-02-13 04:03:59,941 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/.tmp/f1/54e2f0629e864a3b92414640a073c6bc as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/54e2f0629e864a3b92414640a073c6bc 2023-02-13 04:03:59,942 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. completed. 2023-02-13 04:03:59,942 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:03:59,942 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:03:59,942 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. started... 2023-02-13 04:03:59,943 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 04:03:59,943 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 5e339c1446ecfe4a1580a9251f12d5ef 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 04:03:59,945 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/.tmp/f1/a0ad40c35b0e409c85fd086b83848cec as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/a0ad40c35b0e409c85fd086b83848cec 2023-02-13 04:03:59,946 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/7eca6a2fb5a14391a2f313ba03a67ffd, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:03:59,947 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/.tmp/f2/2fb0c4bf53ef4f0390222f2af1824d3d as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/2fb0c4bf53ef4f0390222f2af1824d3d 2023-02-13 04:03:59,948 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/54e2f0629e864a3b92414640a073c6bc, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:59,949 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/.tmp/f2/bf1c819bfe3a4b389dfc5b5b2c3f3ae0 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/bf1c819bfe3a4b389dfc5b5b2c3f3ae0 2023-02-13 04:03:59,950 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/548368985bf8428baae1a0360eebff20, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:59,951 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/.tmp/f2/a8b8302554a3419c900a45b1307f1099 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/a8b8302554a3419c900a45b1307f1099 2023-02-13 04:03:59,951 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/a0ad40c35b0e409c85fd086b83848cec, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:59,952 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/.tmp/f2/3ffc804d7ad0424c9f2dfe088b835333 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/3ffc804d7ad0424c9f2dfe088b835333 2023-02-13 04:03:59,955 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/2fb0c4bf53ef4f0390222f2af1824d3d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:03:59,955 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 12b5f46153081cbbe23dc6da7d51da12 in 161ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:59,957 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 12b5f46153081cbbe23dc6da7d51da12: 2023-02-13 04:03:59,957 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/.tmp/f2/b26bbb81e42e49d3990017cc80cf4eab 2023-02-13 04:03:59,957 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,957 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:59,957 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/7eca6a2fb5a14391a2f313ba03a67ffd] hfiles 2023-02-13 04:03:59,957 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/7eca6a2fb5a14391a2f313ba03a67ffd for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,957 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/2fb0c4bf53ef4f0390222f2af1824d3d] hfiles 2023-02-13 04:03:59,957 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/2fb0c4bf53ef4f0390222f2af1824d3d for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,958 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/bf1c819bfe3a4b389dfc5b5b2c3f3ae0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:59,959 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3a9c07b23e5c3de2995af33ec5953d79 in 166ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:59,959 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3a9c07b23e5c3de2995af33ec5953d79: 2023-02-13 04:03:59,960 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,960 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:59,960 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/54e2f0629e864a3b92414640a073c6bc] hfiles 2023-02-13 04:03:59,960 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/54e2f0629e864a3b92414640a073c6bc for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,960 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/bf1c819bfe3a4b389dfc5b5b2c3f3ae0] hfiles 2023-02-13 04:03:59,960 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/a8b8302554a3419c900a45b1307f1099, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:59,960 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/bf1c819bfe3a4b389dfc5b5b2c3f3ae0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,961 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c7d7f715b522aafb4baaea641912f48a in 166ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:59,961 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c7d7f715b522aafb4baaea641912f48a: 2023-02-13 04:03:59,961 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,961 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:59,961 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/548368985bf8428baae1a0360eebff20] hfiles 2023-02-13 04:03:59,961 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/548368985bf8428baae1a0360eebff20 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,961 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/a8b8302554a3419c900a45b1307f1099] hfiles 2023-02-13 04:03:59,961 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/a8b8302554a3419c900a45b1307f1099 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,965 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/3ffc804d7ad0424c9f2dfe088b835333, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:59,966 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 902e265a9f837f8af40e96b35cfc9f67 in 173ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:59,966 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 902e265a9f837f8af40e96b35cfc9f67: 2023-02-13 04:03:59,966 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,966 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/.tmp/f1/e28b427b921f4bebb82a3fd166626bf8 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/e28b427b921f4bebb82a3fd166626bf8 2023-02-13 04:03:59,966 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:59,966 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/a0ad40c35b0e409c85fd086b83848cec] hfiles 2023-02-13 04:03:59,966 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/a0ad40c35b0e409c85fd086b83848cec for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,966 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/3ffc804d7ad0424c9f2dfe088b835333] hfiles 2023-02-13 04:03:59,966 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/3ffc804d7ad0424c9f2dfe088b835333 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,968 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/.tmp/f1/a5ee7d1691f4451fb7146c7fbbc17fff 2023-02-13 04:03:59,971 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/e28b427b921f4bebb82a3fd166626bf8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:59,972 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/.tmp/f2/b26bbb81e42e49d3990017cc80cf4eab as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/b26bbb81e42e49d3990017cc80cf4eab 2023-02-13 04:03:59,976 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. completed. 2023-02-13 04:03:59,976 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:03:59,976 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 04:03:59,982 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/b26bbb81e42e49d3990017cc80cf4eab, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:03:59,983 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 23600bfb9489de77511b8919349ae24b in 98ms, sequenceid=5, compaction requested=false 2023-02-13 04:03:59,983 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 23600bfb9489de77511b8919349ae24b: 2023-02-13 04:03:59,983 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,983 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:03:59,983 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/e28b427b921f4bebb82a3fd166626bf8] hfiles 2023-02-13 04:03:59,983 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/e28b427b921f4bebb82a3fd166626bf8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,984 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/b26bbb81e42e49d3990017cc80cf4eab] hfiles 2023-02-13 04:03:59,984 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/b26bbb81e42e49d3990017cc80cf4eab for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:03:59,986 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. completed. 2023-02-13 04:03:59,986 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:03:59,986 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 04:03:59,988 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. completed. 2023-02-13 04:03:59,988 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:03:59,988 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:03:59,988 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 04:03:59,988 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. started... 2023-02-13 04:03:59,990 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 0560d2e09b5461c5d897c728ec0fb2e0 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 04:04:00,004 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. completed. 2023-02-13 04:04:00,004 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/.tmp/f2/c23c3f3640494b35aa1579b992649b14 2023-02-13 04:04:00,004 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:00,004 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 04:04:00,008 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/.tmp/f1/994dc84a1d634e598c14356201ec14b0 2023-02-13 04:04:00,009 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/.tmp/f1/a5ee7d1691f4451fb7146c7fbbc17fff as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/a5ee7d1691f4451fb7146c7fbbc17fff 2023-02-13 04:04:00,014 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/a5ee7d1691f4451fb7146c7fbbc17fff, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:04:00,015 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/.tmp/f2/c23c3f3640494b35aa1579b992649b14 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/c23c3f3640494b35aa1579b992649b14 2023-02-13 04:04:00,023 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/c23c3f3640494b35aa1579b992649b14, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 04:04:00,023 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5e339c1446ecfe4a1580a9251f12d5ef in 80ms, sequenceid=5, compaction requested=false 2023-02-13 04:04:00,024 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 5e339c1446ecfe4a1580a9251f12d5ef: 2023-02-13 04:04:00,024 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,024 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:04:00,024 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/a5ee7d1691f4451fb7146c7fbbc17fff] hfiles 2023-02-13 04:04:00,024 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/a5ee7d1691f4451fb7146c7fbbc17fff for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,024 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/c23c3f3640494b35aa1579b992649b14] hfiles 2023-02-13 04:04:00,024 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/c23c3f3640494b35aa1579b992649b14 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,032 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/.tmp/f2/e1c67816b3f94a36b5584d336d4f0bc4 2023-02-13 04:04:00,037 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/.tmp/f1/994dc84a1d634e598c14356201ec14b0 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/994dc84a1d634e598c14356201ec14b0 2023-02-13 04:04:00,038 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. completed. 2023-02-13 04:04:00,039 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:00,039 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 04:04:00,040 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/994dc84a1d634e598c14356201ec14b0, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:04:00,041 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/.tmp/f2/e1c67816b3f94a36b5584d336d4f0bc4 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/e1c67816b3f94a36b5584d336d4f0bc4 2023-02-13 04:04:00,044 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/e1c67816b3f94a36b5584d336d4f0bc4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 04:04:00,045 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 0560d2e09b5461c5d897c728ec0fb2e0 in 55ms, sequenceid=5, compaction requested=false 2023-02-13 04:04:00,045 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 0560d2e09b5461c5d897c728ec0fb2e0: 2023-02-13 04:04:00,045 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,045 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:04:00,045 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/994dc84a1d634e598c14356201ec14b0] hfiles 2023-02-13 04:04:00,046 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/994dc84a1d634e598c14356201ec14b0 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,046 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/e1c67816b3f94a36b5584d336d4f0bc4] hfiles 2023-02-13 04:04:00,046 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/e1c67816b3f94a36b5584d336d4f0bc4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,053 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. completed. 2023-02-13 04:04:00,054 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:00,054 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 04:04:00,054 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 04:04:00,054 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,054 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 04:04:00,054 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,39517,1676261037674' in zk 2023-02-13 04:04:00,055 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:04:00,055 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,055 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 04:04:00,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:00,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:00,055 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:00,056 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 04:04:00,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:00,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:00,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 04:04:00,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:04:00,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,057 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 04:04:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:00,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,39517,1676261037674': 2023-02-13 04:04:00,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39517,1676261037674' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 04:04:00,357 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:04:00,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 04:04:00,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:04:00,358 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 04:04:00,407 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. completed. 2023-02-13 04:04:00,407 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:00,407 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 04:04:00,407 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 04:04:00,407 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,407 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 04:04:00,408 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,41381,1676261037649' in zk 2023-02-13 04:04:00,410 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 04:04:00,410 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,411 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:00,411 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 04:04:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,41381,1676261037649': 2023-02-13 04:04:00,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41381,1676261037649' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 04:04:00,415 INFO [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-13 04:04:00,415 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:04:00,415 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:04:00,415 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,415 INFO [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 04:04:00,417 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,419 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,420 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:00,417 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:00,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,420 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:00,421 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:00,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,421 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:00,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,423 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:00,424 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,430 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:00,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,430 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:00,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:00,430 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:00,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:00,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:00,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:00,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:00,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:00,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,859 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:04:00,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 04:04:00,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:04:00,860 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 04:04:00,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,909 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-13 04:04:00,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,910 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:00,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676261039750Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676261040430 (+680 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676261040430Writing data manifest for testWithMockedMapReduceMultiRegion at 1676261040452 (+22 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676261040868 (+416 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676261040909 (+41 ms) 2023-02-13 04:04:00,912 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 04:04:00,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 1.1610 sec 2023-02-13 04:04:01,861 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:04:01,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 04:04:01,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 04:04:01,862 INFO [Listener at localhost/36569] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 04:04:01,866 INFO [Listener at localhost/36569] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 04:04:01,872 INFO [Listener at localhost/36569] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 04:04:01,890 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41381] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:01,897 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39517] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:01,960 INFO [Listener at localhost/36569] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 04:04:01,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:04:01,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,968 INFO [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-13 04:04:01,968 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:01,969 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-13 04:04:01,969 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 04:04:01,970 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,970 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,976 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:01,976 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:01,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:01,976 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:01,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:01,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:01,977 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:01,977 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,977 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:01,977 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:04:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:04:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,977 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:04:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,978 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 04:04:01,978 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-13 04:04:01,978 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:01,978 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-13 04:04:01,979 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 04:04:01,979 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. started... 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. started... 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:01,980 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 902e265a9f837f8af40e96b35cfc9f67 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:04:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 04:04:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. started... 2023-02-13 04:04:01,980 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c7d7f715b522aafb4baaea641912f48a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:04:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. started... 2023-02-13 04:04:01,980 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3a9c07b23e5c3de2995af33ec5953d79 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:04:01,980 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 81c803a453213180a0941d1de82923f8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. started... 2023-02-13 04:04:01,981 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 11582139dfb10d92dc5b9f056cb10216: 2023-02-13 04:04:01,980 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. started... 2023-02-13 04:04:01,981 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:01,981 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 12b5f46153081cbbe23dc6da7d51da12 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 04:04:01,982 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:01,982 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. started... 2023-02-13 04:04:01,982 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 84863e66b3da719eb4cb244e7c2cb3b2: 2023-02-13 04:04:01,982 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:01,982 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:01,982 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. started... 2023-02-13 04:04:01,982 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 04:04:01,983 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 04:04:01,984 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 23600bfb9489de77511b8919349ae24b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:04:02,011 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/.tmp/f1/19f26777e424471fa50b9f4b8917547a 2023-02-13 04:04:02,020 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/.tmp/f1/30126be5a10c40a3afbe48222d00a863 2023-02-13 04:04:02,022 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/.tmp/f1/32e0ac4b680b4594b0714f05a3ccd8db 2023-02-13 04:04:02,022 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/.tmp/f1/8c20c3ff1d294bd7934b8ff35bd890eb 2023-02-13 04:04:02,024 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/.tmp/f1/c52fd3212cb24fbcb6bf38fb06ff65f0 2023-02-13 04:04:02,031 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/.tmp/f1/e7a9602b04a741d88dfaf6ca58bedf02 2023-02-13 04:04:02,064 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/.tmp/f2/2a601413de714e6a9b74b61e61f6095c 2023-02-13 04:04:02,069 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/.tmp/f1/19f26777e424471fa50b9f4b8917547a as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/19f26777e424471fa50b9f4b8917547a 2023-02-13 04:04:02,073 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/19f26777e424471fa50b9f4b8917547a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:04:02,074 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/.tmp/f2/2a601413de714e6a9b74b61e61f6095c as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/2a601413de714e6a9b74b61e61f6095c 2023-02-13 04:04:02,080 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/.tmp/f2/b5b976a7bd734eb1b0ffd2cc8a977662 2023-02-13 04:04:02,090 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/.tmp/f2/64ccffc4ccd74a98a9548b472f866483 2023-02-13 04:04:02,090 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/.tmp/f1/30126be5a10c40a3afbe48222d00a863 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/30126be5a10c40a3afbe48222d00a863 2023-02-13 04:04:02,090 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/2a601413de714e6a9b74b61e61f6095c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:04:02,091 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 12b5f46153081cbbe23dc6da7d51da12 in 110ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:02,091 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 12b5f46153081cbbe23dc6da7d51da12: 2023-02-13 04:04:02,091 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:02,091 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 04:04:02,094 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/30126be5a10c40a3afbe48222d00a863, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,094 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/.tmp/f1/32e0ac4b680b4594b0714f05a3ccd8db as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/32e0ac4b680b4594b0714f05a3ccd8db 2023-02-13 04:04:02,095 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/.tmp/f2/b5b976a7bd734eb1b0ffd2cc8a977662 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/b5b976a7bd734eb1b0ffd2cc8a977662 2023-02-13 04:04:02,098 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/32e0ac4b680b4594b0714f05a3ccd8db, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,098 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/b5b976a7bd734eb1b0ffd2cc8a977662, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,099 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/.tmp/f2/64ccffc4ccd74a98a9548b472f866483 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/64ccffc4ccd74a98a9548b472f866483 2023-02-13 04:04:02,099 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3a9c07b23e5c3de2995af33ec5953d79 in 119ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:02,099 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3a9c07b23e5c3de2995af33ec5953d79: 2023-02-13 04:04:02,099 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:02,099 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 04:04:02,108 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/.tmp/f2/bafddc6e82b34b959f5c67f7a961a813 2023-02-13 04:04:02,110 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/.tmp/f2/a9789d2a73724ca8a024ff83d22e0048 2023-02-13 04:04:02,114 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/.tmp/f1/c52fd3212cb24fbcb6bf38fb06ff65f0 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/c52fd3212cb24fbcb6bf38fb06ff65f0 2023-02-13 04:04:02,115 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/.tmp/f1/e7a9602b04a741d88dfaf6ca58bedf02 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/e7a9602b04a741d88dfaf6ca58bedf02 2023-02-13 04:04:02,116 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/.tmp/f2/a23f4832d3c049988263ef68e38521a3 2023-02-13 04:04:02,117 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/64ccffc4ccd74a98a9548b472f866483, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,118 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 81c803a453213180a0941d1de82923f8 in 138ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:02,118 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 81c803a453213180a0941d1de82923f8: 2023-02-13 04:04:02,118 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:02,118 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:02,118 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 04:04:02,118 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. started... 2023-02-13 04:04:02,119 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/c52fd3212cb24fbcb6bf38fb06ff65f0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,119 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5e339c1446ecfe4a1580a9251f12d5ef 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 04:04:02,121 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/.tmp/f2/bafddc6e82b34b959f5c67f7a961a813 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/bafddc6e82b34b959f5c67f7a961a813 2023-02-13 04:04:02,124 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/bafddc6e82b34b959f5c67f7a961a813, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,125 INFO [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 23600bfb9489de77511b8919349ae24b in 143ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:02,125 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 23600bfb9489de77511b8919349ae24b: 2023-02-13 04:04:02,125 DEBUG [rs(jenkins-hbase4.apache.org,41381,1676261037649)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:02,125 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 04:04:02,125 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 04:04:02,125 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,125 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 04:04:02,125 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41381,1676261037649' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 04:04:02,127 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,127 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:02,128 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,128 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:02,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:02,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:02,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:02,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41381,1676261037649' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 04:04:02,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5521b71e[Count = 1] remaining members to acquire global barrier 2023-02-13 04:04:02,132 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/.tmp/f1/8c20c3ff1d294bd7934b8ff35bd890eb as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/8c20c3ff1d294bd7934b8ff35bd890eb 2023-02-13 04:04:02,132 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/e7a9602b04a741d88dfaf6ca58bedf02, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,133 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/.tmp/f2/a9789d2a73724ca8a024ff83d22e0048 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/a9789d2a73724ca8a024ff83d22e0048 2023-02-13 04:04:02,144 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/8c20c3ff1d294bd7934b8ff35bd890eb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,144 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/a9789d2a73724ca8a024ff83d22e0048, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,144 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/.tmp/f2/a23f4832d3c049988263ef68e38521a3 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/a23f4832d3c049988263ef68e38521a3 2023-02-13 04:04:02,145 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c7d7f715b522aafb4baaea641912f48a in 165ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:02,145 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c7d7f715b522aafb4baaea641912f48a: 2023-02-13 04:04:02,145 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:02,145 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:02,145 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 04:04:02,145 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. started... 2023-02-13 04:04:02,146 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0560d2e09b5461c5d897c728ec0fb2e0 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 04:04:02,149 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/.tmp/f1/ff2c17d787ae48268eae9db1288b5f4d 2023-02-13 04:04:02,150 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/a23f4832d3c049988263ef68e38521a3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,150 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 902e265a9f837f8af40e96b35cfc9f67 in 170ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:02,151 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 902e265a9f837f8af40e96b35cfc9f67: 2023-02-13 04:04:02,151 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:02,151 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 04:04:02,156 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/.tmp/f1/4b15c3abd4cd4421a98f6053bfb4e4ca 2023-02-13 04:04:02,170 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/.tmp/f2/1d6d144b6631411caa6935371b480113 2023-02-13 04:04:02,174 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/.tmp/f1/4b15c3abd4cd4421a98f6053bfb4e4ca as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/4b15c3abd4cd4421a98f6053bfb4e4ca 2023-02-13 04:04:02,179 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/4b15c3abd4cd4421a98f6053bfb4e4ca, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:04:02,180 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/.tmp/f2/1d6d144b6631411caa6935371b480113 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/1d6d144b6631411caa6935371b480113 2023-02-13 04:04:02,184 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/1d6d144b6631411caa6935371b480113, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 04:04:02,185 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 0560d2e09b5461c5d897c728ec0fb2e0 in 40ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:02,185 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0560d2e09b5461c5d897c728ec0fb2e0: 2023-02-13 04:04:02,185 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:02,185 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 04:04:02,564 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/.tmp/f2/83d1689f9448411bbf2aff96f7445551 2023-02-13 04:04:02,570 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/.tmp/f1/ff2c17d787ae48268eae9db1288b5f4d as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/ff2c17d787ae48268eae9db1288b5f4d 2023-02-13 04:04:02,574 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/ff2c17d787ae48268eae9db1288b5f4d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,575 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/.tmp/f2/83d1689f9448411bbf2aff96f7445551 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/83d1689f9448411bbf2aff96f7445551 2023-02-13 04:04:02,579 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/83d1689f9448411bbf2aff96f7445551, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 04:04:02,580 INFO [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5e339c1446ecfe4a1580a9251f12d5ef in 461ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:02,580 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5e339c1446ecfe4a1580a9251f12d5ef: 2023-02-13 04:04:02,580 DEBUG [rs(jenkins-hbase4.apache.org,39517,1676261037674)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:02,580 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 04:04:02,580 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 04:04:02,580 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,580 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 04:04:02,580 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39517,1676261037674' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 04:04:02,582 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,582 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:02,582 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,582 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:02,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39517,1676261037674' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 04:04:02,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5521b71e[Count = 0] remaining members to acquire global barrier 2023-02-13 04:04:02,584 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 04:04:02,584 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,585 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,585 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,585 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 04:04:02,585 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,585 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 04:04:02,585 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 04:04:02,585 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 04:04:02,585 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,41381,1676261037649' in zk 2023-02-13 04:04:02,585 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,39517,1676261037674' in zk 2023-02-13 04:04:02,585 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,585 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:04:02,587 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,588 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 04:04:02,588 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 04:04:02,588 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:02,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:02,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:02,588 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,588 DEBUG [member: 'jenkins-hbase4.apache.org,41381,1676261037649' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 04:04:02,588 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:02,588 DEBUG [member: 'jenkins-hbase4.apache.org,39517,1676261037674' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 04:04:02,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:02,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:02,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,39517,1676261037674': 2023-02-13 04:04:02,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39517,1676261037674' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 04:04:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,41381,1676261037649': 2023-02-13 04:04:02,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41381,1676261037649' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 04:04:02,592 INFO [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-13 04:04:02,592 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:04:02,593 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:04:02,593 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,593 INFO [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:04:02,594 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,594 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:02,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:02,594 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:02,594 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,594 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:02,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:02,595 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,595 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,596 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:02,597 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,599 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,599 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,599 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:02,599 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:02,599 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:02,599 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,599 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:02,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:02,599 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:02,599 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:02,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-13 04:04:02,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:04:02,599 DEBUG [(jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:02,599 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:02,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:02,600 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:02,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:02,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:02,600 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,600 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,600 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-13 04:04:02,600 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:04:02,700 DEBUG [Listener at localhost/36569] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:04:02,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:04:02,707 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676261039735 type: FLUSH version: 2 ttl: 0 2023-02-13 04:04:02,707 DEBUG [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(239): region to add: 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(239): region to add: 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(239): region to add: 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(239): region to add: 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(239): region to add: c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(239): region to add: 81c803a453213180a0941d1de82923f8 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(239): region to add: 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(239): region to add: 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(239): region to add: 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(239): region to add: 23600bfb9489de77511b8919349ae24b 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(585): clone region=3a9c07b23e5c3de2995af33ec5953d79 as 3a9c07b23e5c3de2995af33ec5953d79 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,708 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(585): clone region=902e265a9f837f8af40e96b35cfc9f67 as 902e265a9f837f8af40e96b35cfc9f67 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,709 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(585): clone region=12b5f46153081cbbe23dc6da7d51da12 as 12b5f46153081cbbe23dc6da7d51da12 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,709 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(585): clone region=11582139dfb10d92dc5b9f056cb10216 as 11582139dfb10d92dc5b9f056cb10216 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,709 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(585): clone region=c7d7f715b522aafb4baaea641912f48a as c7d7f715b522aafb4baaea641912f48a in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,709 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(585): clone region=81c803a453213180a0941d1de82923f8 as 81c803a453213180a0941d1de82923f8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,709 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(585): clone region=5e339c1446ecfe4a1580a9251f12d5ef as 5e339c1446ecfe4a1580a9251f12d5ef in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,709 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(585): clone region=0560d2e09b5461c5d897c728ec0fb2e0 as 0560d2e09b5461c5d897c728ec0fb2e0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,709 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(585): clone region=84863e66b3da719eb4cb244e7c2cb3b2 as 84863e66b3da719eb4cb244e7c2cb3b2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,709 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(585): clone region=23600bfb9489de77511b8919349ae24b as 23600bfb9489de77511b8919349ae24b in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,711 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 11582139dfb10d92dc5b9f056cb10216, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:02,711 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 902e265a9f837f8af40e96b35cfc9f67, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:02,711 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 81c803a453213180a0941d1de82923f8, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:02,711 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => c7d7f715b522aafb4baaea641912f48a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:02,711 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 12b5f46153081cbbe23dc6da7d51da12, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:02,712 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 0560d2e09b5461c5d897c728ec0fb2e0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:02,712 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3a9c07b23e5c3de2995af33ec5953d79, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:02,712 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 5e339c1446ecfe4a1580a9251f12d5ef, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:02,735 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:02,735 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a0ad40c35b0e409c85fd086b83848cec from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,745 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3ffc804d7ad0424c9f2dfe088b835333 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,747 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:02,747 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 11582139dfb10d92dc5b9f056cb10216, disabling compactions & flushes 2023-02-13 04:04:02,747 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:02,747 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:02,747 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. after waiting 0 ms 2023-02-13 04:04:02,747 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:02,747 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:02,747 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 11582139dfb10d92dc5b9f056cb10216: Waiting for close lock at 1676261042747Disabling compacts and flushes for region at 1676261042747Disabling writes for close at 1676261042747Writing region close event to WAL at 1676261042747Closed at 1676261042747 2023-02-13 04:04:02,748 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 84863e66b3da719eb4cb244e7c2cb3b2, NAME => 'testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:02,752 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:02,752 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c60d61e6262242fc84a3695c6f46af40 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,753 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:02,754 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 548368985bf8428baae1a0360eebff20 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,761 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 902e265a9f837f8af40e96b35cfc9f67, disabling compactions & flushes 2023-02-13 04:04:02,761 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:02,761 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:02,762 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. after waiting 0 ms 2023-02-13 04:04:02,762 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:02,762 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:02,762 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 902e265a9f837f8af40e96b35cfc9f67: Waiting for close lock at 1676261042761Disabling compacts and flushes for region at 1676261042761Disabling writes for close at 1676261042762 (+1 ms)Writing region close event to WAL at 1676261042762Closed at 1676261042762 2023-02-13 04:04:02,762 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 23600bfb9489de77511b8919349ae24b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:02,763 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3769dfd8d46f4565829fa13f82b42f9c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,763 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:02,763 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a5ee7d1691f4451fb7146c7fbbc17fff from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,763 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:02,763 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 54e2f0629e864a3b92414640a073c6bc from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,763 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a8b8302554a3419c900a45b1307f1099 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,765 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:02,765 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 994dc84a1d634e598c14356201ec14b0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,773 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 81c803a453213180a0941d1de82923f8, disabling compactions & flushes 2023-02-13 04:04:02,773 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e1c67816b3f94a36b5584d336d4f0bc4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,773 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:02,773 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:02,773 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. after waiting 0 ms 2023-02-13 04:04:02,773 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:02,773 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:02,773 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 81c803a453213180a0941d1de82923f8: Waiting for close lock at 1676261042772Disabling compacts and flushes for region at 1676261042772Disabling writes for close at 1676261042773 (+1 ms)Writing region close event to WAL at 1676261042773Closed at 1676261042773 2023-02-13 04:04:02,773 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c23c3f3640494b35aa1579b992649b14 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,773 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing c7d7f715b522aafb4baaea641912f48a, disabling compactions & flushes 2023-02-13 04:04:02,773 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:02,773 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:02,773 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. after waiting 0 ms 2023-02-13 04:04:02,773 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:02,774 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:02,774 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for c7d7f715b522aafb4baaea641912f48a: Waiting for close lock at 1676261042773Disabling compacts and flushes for region at 1676261042773Disabling writes for close at 1676261042773Writing region close event to WAL at 1676261042774 (+1 ms)Closed at 1676261042774 2023-02-13 04:04:02,774 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bf1c819bfe3a4b389dfc5b5b2c3f3ae0 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,776 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:02,776 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 0560d2e09b5461c5d897c728ec0fb2e0, disabling compactions & flushes 2023-02-13 04:04:02,776 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:02,776 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 84863e66b3da719eb4cb244e7c2cb3b2, disabling compactions & flushes 2023-02-13 04:04:02,776 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:02,776 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:02,776 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:02,776 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. after waiting 0 ms 2023-02-13 04:04:02,776 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. after waiting 0 ms 2023-02-13 04:04:02,777 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:02,777 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:02,777 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 84863e66b3da719eb4cb244e7c2cb3b2: Waiting for close lock at 1676261042776Disabling compacts and flushes for region at 1676261042776Disabling writes for close at 1676261042777 (+1 ms)Writing region close event to WAL at 1676261042777Closed at 1676261042777 2023-02-13 04:04:02,777 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:02,777 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:02,777 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 0560d2e09b5461c5d897c728ec0fb2e0: Waiting for close lock at 1676261042776Disabling compacts and flushes for region at 1676261042776Disabling writes for close at 1676261042777 (+1 ms)Writing region close event to WAL at 1676261042777Closed at 1676261042777 2023-02-13 04:04:02,788 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 5e339c1446ecfe4a1580a9251f12d5ef, disabling compactions & flushes 2023-02-13 04:04:02,788 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:02,788 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:02,788 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. after waiting 0 ms 2023-02-13 04:04:02,788 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:02,788 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:02,788 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 5e339c1446ecfe4a1580a9251f12d5ef: Waiting for close lock at 1676261042788Disabling compacts and flushes for region at 1676261042788Disabling writes for close at 1676261042788Writing region close event to WAL at 1676261042788Closed at 1676261042788 2023-02-13 04:04:02,789 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3a9c07b23e5c3de2995af33ec5953d79, disabling compactions & flushes 2023-02-13 04:04:02,789 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:02,789 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:02,789 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. after waiting 0 ms 2023-02-13 04:04:02,789 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:02,789 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:02,789 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3a9c07b23e5c3de2995af33ec5953d79: Waiting for close lock at 1676261042789Disabling compacts and flushes for region at 1676261042789Disabling writes for close at 1676261042789Writing region close event to WAL at 1676261042789Closed at 1676261042789 2023-02-13 04:04:02,790 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:02,790 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e28b427b921f4bebb82a3fd166626bf8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,792 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b26bbb81e42e49d3990017cc80cf4eab from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:02,794 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 23600bfb9489de77511b8919349ae24b, disabling compactions & flushes 2023-02-13 04:04:02,794 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:02,794 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:02,794 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. after waiting 0 ms 2023-02-13 04:04:02,794 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:02,794 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:02,794 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 23600bfb9489de77511b8919349ae24b: Waiting for close lock at 1676261042794Disabling compacts and flushes for region at 1676261042794Disabling writes for close at 1676261042794Writing region close event to WAL at 1676261042794Closed at 1676261042794 2023-02-13 04:04:03,164 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,164 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7eca6a2fb5a14391a2f313ba03a67ffd from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:03,166 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2fb0c4bf53ef4f0390222f2af1824d3d from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:03,168 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 12b5f46153081cbbe23dc6da7d51da12, disabling compactions & flushes 2023-02-13 04:04:03,168 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:03,168 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:03,168 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. after waiting 0 ms 2023-02-13 04:04:03,168 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:03,168 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:03,168 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 12b5f46153081cbbe23dc6da7d51da12: Waiting for close lock at 1676261043168Disabling compacts and flushes for region at 1676261043168Disabling writes for close at 1676261043168Writing region close event to WAL at 1676261043168Closed at 1676261043168 2023-02-13 04:04:03,168 INFO [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676261039735 type: FLUSH version: 2 ttl: 0 2023-02-13 04:04:03,169 DEBUG [Listener at localhost/36569] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:03,169 DEBUG [Listener at localhost/36569] util.CommonFSUtils(682): File system contents for path hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027 2023-02-13 04:04:03,169 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-data/ 2023-02-13 04:04:03,170 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----default/ 2023-02-13 04:04:03,170 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-13 04:04:03,170 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----------0560d2e09b5461c5d897c728ec0fb2e0/ 2023-02-13 04:04:03,171 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:03,171 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:03,171 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0560d2e09b5461c5d897c728ec0fb2e0-994dc84a1d634e598c14356201ec14b0 2023-02-13 04:04:03,171 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:03,171 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0560d2e09b5461c5d897c728ec0fb2e0-e1c67816b3f94a36b5584d336d4f0bc4 2023-02-13 04:04:03,172 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----------11582139dfb10d92dc5b9f056cb10216/ 2023-02-13 04:04:03,172 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:03,172 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----------12b5f46153081cbbe23dc6da7d51da12/ 2023-02-13 04:04:03,172 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:03,172 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:03,173 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=12b5f46153081cbbe23dc6da7d51da12-7eca6a2fb5a14391a2f313ba03a67ffd 2023-02-13 04:04:03,173 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:03,173 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=12b5f46153081cbbe23dc6da7d51da12-2fb0c4bf53ef4f0390222f2af1824d3d 2023-02-13 04:04:03,173 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----------23600bfb9489de77511b8919349ae24b/ 2023-02-13 04:04:03,173 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:03,173 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:03,174 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=23600bfb9489de77511b8919349ae24b-e28b427b921f4bebb82a3fd166626bf8 2023-02-13 04:04:03,174 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:03,174 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=23600bfb9489de77511b8919349ae24b-b26bbb81e42e49d3990017cc80cf4eab 2023-02-13 04:04:03,174 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----------3a9c07b23e5c3de2995af33ec5953d79/ 2023-02-13 04:04:03,175 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:03,175 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:03,175 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3a9c07b23e5c3de2995af33ec5953d79-54e2f0629e864a3b92414640a073c6bc 2023-02-13 04:04:03,175 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:03,175 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3a9c07b23e5c3de2995af33ec5953d79-bf1c819bfe3a4b389dfc5b5b2c3f3ae0 2023-02-13 04:04:03,176 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----------5e339c1446ecfe4a1580a9251f12d5ef/ 2023-02-13 04:04:03,176 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:03,176 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:03,176 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5e339c1446ecfe4a1580a9251f12d5ef-a5ee7d1691f4451fb7146c7fbbc17fff 2023-02-13 04:04:03,176 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:03,177 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5e339c1446ecfe4a1580a9251f12d5ef-c23c3f3640494b35aa1579b992649b14 2023-02-13 04:04:03,177 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----------81c803a453213180a0941d1de82923f8/ 2023-02-13 04:04:03,177 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:03,177 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:03,178 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=81c803a453213180a0941d1de82923f8-c60d61e6262242fc84a3695c6f46af40 2023-02-13 04:04:03,178 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:03,178 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=81c803a453213180a0941d1de82923f8-3769dfd8d46f4565829fa13f82b42f9c 2023-02-13 04:04:03,178 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----------84863e66b3da719eb4cb244e7c2cb3b2/ 2023-02-13 04:04:03,178 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:03,178 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----------902e265a9f837f8af40e96b35cfc9f67/ 2023-02-13 04:04:03,179 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:03,179 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:03,179 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=902e265a9f837f8af40e96b35cfc9f67-a0ad40c35b0e409c85fd086b83848cec 2023-02-13 04:04:03,179 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:03,179 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=902e265a9f837f8af40e96b35cfc9f67-3ffc804d7ad0424c9f2dfe088b835333 2023-02-13 04:04:03,179 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |----------c7d7f715b522aafb4baaea641912f48a/ 2023-02-13 04:04:03,180 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:03,180 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:03,180 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c7d7f715b522aafb4baaea641912f48a-548368985bf8428baae1a0360eebff20 2023-02-13 04:04:03,180 DEBUG [Listener at localhost/36569] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:03,180 DEBUG [Listener at localhost/36569] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c7d7f715b522aafb4baaea641912f48a-a8b8302554a3419c900a45b1307f1099 2023-02-13 04:04:03,183 INFO [Listener at localhost/36569] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 04:04:03,723 DEBUG [Listener at localhost/36569] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,723 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:03,725 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:03,727 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:04:03,728 DEBUG [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1 2023-02-13 04:04:03,729 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0560d2e09b5461c5d897c728ec0fb2e0 columnFamilyName f1 2023-02-13 04:04:03,733 DEBUG [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/testWithMockedMapReduceMultiRegion=0560d2e09b5461c5d897c728ec0fb2e0-994dc84a1d634e598c14356201ec14b0 2023-02-13 04:04:03,733 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] regionserver.HStore(310): Store=0560d2e09b5461c5d897c728ec0fb2e0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,734 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:04:03,734 DEBUG [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2 2023-02-13 04:04:03,735 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0560d2e09b5461c5d897c728ec0fb2e0 columnFamilyName f2 2023-02-13 04:04:03,739 DEBUG [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/testWithMockedMapReduceMultiRegion=0560d2e09b5461c5d897c728ec0fb2e0-e1c67816b3f94a36b5584d336d4f0bc4 2023-02-13 04:04:03,739 INFO [StoreOpener-0560d2e09b5461c5d897c728ec0fb2e0-1] regionserver.HStore(310): Store=0560d2e09b5461c5d897c728ec0fb2e0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,739 DEBUG [Listener at localhost/36569] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:03,739 INFO [Listener at localhost/36569] regionserver.HRegion(1071): Opened 0560d2e09b5461c5d897c728ec0fb2e0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66664133, jitterRate=-0.006627008318901062}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:03,739 DEBUG [Listener at localhost/36569] regionserver.HRegion(964): Region open journal for 0560d2e09b5461c5d897c728ec0fb2e0: Writing region info on filesystem at 1676261043725Initializing all the Stores at 1676261043726 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043726Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043726Region opened successfully at 1676261043739 (+13 ms) 2023-02-13 04:04:03,752 DEBUG [Listener at localhost/36569] regionserver.HRegion(1603): Closing 0560d2e09b5461c5d897c728ec0fb2e0, disabling compactions & flushes 2023-02-13 04:04:03,752 INFO [Listener at localhost/36569] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:03,752 DEBUG [Listener at localhost/36569] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:03,752 DEBUG [Listener at localhost/36569] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. after waiting 0 ms 2023-02-13 04:04:03,752 DEBUG [Listener at localhost/36569] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:03,753 INFO [Listener at localhost/36569] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:03,753 DEBUG [Listener at localhost/36569] regionserver.HRegion(1557): Region close journal for 0560d2e09b5461c5d897c728ec0fb2e0: Waiting for close lock at 1676261043752Disabling compacts and flushes for region at 1676261043752Disabling writes for close at 1676261043752Writing region close event to WAL at 1676261043753 (+1 ms)Closed at 1676261043753 2023-02-13 04:04:03,754 DEBUG [Listener at localhost/36569] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,754 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:03,760 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:03,763 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:04:03,763 DEBUG [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1 2023-02-13 04:04:03,764 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e339c1446ecfe4a1580a9251f12d5ef columnFamilyName f1 2023-02-13 04:04:03,769 DEBUG [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/testWithMockedMapReduceMultiRegion=5e339c1446ecfe4a1580a9251f12d5ef-a5ee7d1691f4451fb7146c7fbbc17fff 2023-02-13 04:04:03,770 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] regionserver.HStore(310): Store=5e339c1446ecfe4a1580a9251f12d5ef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,770 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:04:03,771 DEBUG [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2 2023-02-13 04:04:03,771 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e339c1446ecfe4a1580a9251f12d5ef columnFamilyName f2 2023-02-13 04:04:03,777 DEBUG [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/testWithMockedMapReduceMultiRegion=5e339c1446ecfe4a1580a9251f12d5ef-c23c3f3640494b35aa1579b992649b14 2023-02-13 04:04:03,777 INFO [StoreOpener-5e339c1446ecfe4a1580a9251f12d5ef-1] regionserver.HStore(310): Store=5e339c1446ecfe4a1580a9251f12d5ef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,777 DEBUG [Listener at localhost/36569] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:03,777 INFO [Listener at localhost/36569] regionserver.HRegion(1071): Opened 5e339c1446ecfe4a1580a9251f12d5ef; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74933093, jitterRate=0.11659009754657745}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:03,777 DEBUG [Listener at localhost/36569] regionserver.HRegion(964): Region open journal for 5e339c1446ecfe4a1580a9251f12d5ef: Writing region info on filesystem at 1676261043760Initializing all the Stores at 1676261043761 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043761Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043761Region opened successfully at 1676261043777 (+16 ms) 2023-02-13 04:04:03,786 DEBUG [Listener at localhost/36569] regionserver.HRegion(1603): Closing 5e339c1446ecfe4a1580a9251f12d5ef, disabling compactions & flushes 2023-02-13 04:04:03,787 INFO [Listener at localhost/36569] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:03,787 DEBUG [Listener at localhost/36569] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:03,787 DEBUG [Listener at localhost/36569] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. after waiting 0 ms 2023-02-13 04:04:03,787 DEBUG [Listener at localhost/36569] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:03,787 INFO [Listener at localhost/36569] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:03,788 DEBUG [Listener at localhost/36569] regionserver.HRegion(1557): Region close journal for 5e339c1446ecfe4a1580a9251f12d5ef: Waiting for close lock at 1676261043785Disabling compacts and flushes for region at 1676261043785Disabling writes for close at 1676261043787 (+2 ms)Writing region close event to WAL at 1676261043787Closed at 1676261043787 2023-02-13 04:04:03,788 DEBUG [Listener at localhost/36569] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,788 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:03,789 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:03,791 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 23600bfb9489de77511b8919349ae24b 2023-02-13 04:04:03,792 DEBUG [StoreOpener-23600bfb9489de77511b8919349ae24b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1 2023-02-13 04:04:03,792 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23600bfb9489de77511b8919349ae24b columnFamilyName f1 2023-02-13 04:04:03,796 DEBUG [StoreOpener-23600bfb9489de77511b8919349ae24b-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/testWithMockedMapReduceMultiRegion=23600bfb9489de77511b8919349ae24b-e28b427b921f4bebb82a3fd166626bf8 2023-02-13 04:04:03,796 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] regionserver.HStore(310): Store=23600bfb9489de77511b8919349ae24b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,796 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 23600bfb9489de77511b8919349ae24b 2023-02-13 04:04:03,797 DEBUG [StoreOpener-23600bfb9489de77511b8919349ae24b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2 2023-02-13 04:04:03,797 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23600bfb9489de77511b8919349ae24b columnFamilyName f2 2023-02-13 04:04:03,801 DEBUG [StoreOpener-23600bfb9489de77511b8919349ae24b-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/testWithMockedMapReduceMultiRegion=23600bfb9489de77511b8919349ae24b-b26bbb81e42e49d3990017cc80cf4eab 2023-02-13 04:04:03,801 INFO [StoreOpener-23600bfb9489de77511b8919349ae24b-1] regionserver.HStore(310): Store=23600bfb9489de77511b8919349ae24b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,801 DEBUG [Listener at localhost/36569] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:03,801 INFO [Listener at localhost/36569] regionserver.HRegion(1071): Opened 23600bfb9489de77511b8919349ae24b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69800198, jitterRate=0.04010400176048279}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:03,801 DEBUG [Listener at localhost/36569] regionserver.HRegion(964): Region open journal for 23600bfb9489de77511b8919349ae24b: Writing region info on filesystem at 1676261043789Initializing all the Stores at 1676261043790 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043790Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043790Region opened successfully at 1676261043801 (+11 ms) 2023-02-13 04:04:03,809 DEBUG [Listener at localhost/36569] regionserver.HRegion(1603): Closing 23600bfb9489de77511b8919349ae24b, disabling compactions & flushes 2023-02-13 04:04:03,809 INFO [Listener at localhost/36569] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:03,809 DEBUG [Listener at localhost/36569] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:03,809 DEBUG [Listener at localhost/36569] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. after waiting 0 ms 2023-02-13 04:04:03,809 DEBUG [Listener at localhost/36569] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:03,810 INFO [Listener at localhost/36569] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:03,810 DEBUG [Listener at localhost/36569] regionserver.HRegion(1557): Region close journal for 23600bfb9489de77511b8919349ae24b: Waiting for close lock at 1676261043809Disabling compacts and flushes for region at 1676261043809Disabling writes for close at 1676261043809Writing region close event to WAL at 1676261043810 (+1 ms)Closed at 1676261043810 2023-02-13 04:04:03,811 DEBUG [Listener at localhost/36569] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,811 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:03,812 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:03,817 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:04:03,818 DEBUG [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/f1 2023-02-13 04:04:03,818 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11582139dfb10d92dc5b9f056cb10216 columnFamilyName f1 2023-02-13 04:04:03,818 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] regionserver.HStore(310): Store=11582139dfb10d92dc5b9f056cb10216/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,818 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:04:03,819 DEBUG [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/f2 2023-02-13 04:04:03,820 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11582139dfb10d92dc5b9f056cb10216 columnFamilyName f2 2023-02-13 04:04:03,820 INFO [StoreOpener-11582139dfb10d92dc5b9f056cb10216-1] regionserver.HStore(310): Store=11582139dfb10d92dc5b9f056cb10216/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,820 DEBUG [Listener at localhost/36569] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:03,821 INFO [Listener at localhost/36569] regionserver.HRegion(1071): Opened 11582139dfb10d92dc5b9f056cb10216; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70945395, jitterRate=0.05716876685619354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:03,821 DEBUG [Listener at localhost/36569] regionserver.HRegion(964): Region open journal for 11582139dfb10d92dc5b9f056cb10216: Writing region info on filesystem at 1676261043812Initializing all the Stores at 1676261043813 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043813Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043816 (+3 ms)Region opened successfully at 1676261043821 (+5 ms) 2023-02-13 04:04:03,821 DEBUG [Listener at localhost/36569] regionserver.HRegion(1603): Closing 11582139dfb10d92dc5b9f056cb10216, disabling compactions & flushes 2023-02-13 04:04:03,821 INFO [Listener at localhost/36569] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:03,821 DEBUG [Listener at localhost/36569] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:03,821 DEBUG [Listener at localhost/36569] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. after waiting 0 ms 2023-02-13 04:04:03,821 DEBUG [Listener at localhost/36569] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:03,822 INFO [Listener at localhost/36569] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:03,822 DEBUG [Listener at localhost/36569] regionserver.HRegion(1557): Region close journal for 11582139dfb10d92dc5b9f056cb10216: Waiting for close lock at 1676261043821Disabling compacts and flushes for region at 1676261043821Disabling writes for close at 1676261043821Writing region close event to WAL at 1676261043822 (+1 ms)Closed at 1676261043822 2023-02-13 04:04:03,822 DEBUG [Listener at localhost/36569] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,823 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:03,824 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:03,828 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:04:03,829 DEBUG [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1 2023-02-13 04:04:03,829 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a9c07b23e5c3de2995af33ec5953d79 columnFamilyName f1 2023-02-13 04:04:03,833 DEBUG [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/testWithMockedMapReduceMultiRegion=3a9c07b23e5c3de2995af33ec5953d79-54e2f0629e864a3b92414640a073c6bc 2023-02-13 04:04:03,833 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] regionserver.HStore(310): Store=3a9c07b23e5c3de2995af33ec5953d79/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,834 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:04:03,834 DEBUG [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2 2023-02-13 04:04:03,834 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a9c07b23e5c3de2995af33ec5953d79 columnFamilyName f2 2023-02-13 04:04:03,838 DEBUG [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/testWithMockedMapReduceMultiRegion=3a9c07b23e5c3de2995af33ec5953d79-bf1c819bfe3a4b389dfc5b5b2c3f3ae0 2023-02-13 04:04:03,839 INFO [StoreOpener-3a9c07b23e5c3de2995af33ec5953d79-1] regionserver.HStore(310): Store=3a9c07b23e5c3de2995af33ec5953d79/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,839 DEBUG [Listener at localhost/36569] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:03,839 INFO [Listener at localhost/36569] regionserver.HRegion(1071): Opened 3a9c07b23e5c3de2995af33ec5953d79; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65429305, jitterRate=-0.025027379393577576}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:03,839 DEBUG [Listener at localhost/36569] regionserver.HRegion(964): Region open journal for 3a9c07b23e5c3de2995af33ec5953d79: Writing region info on filesystem at 1676261043824Initializing all the Stores at 1676261043825 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043825Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043828 (+3 ms)Region opened successfully at 1676261043839 (+11 ms) 2023-02-13 04:04:03,847 DEBUG [Listener at localhost/36569] regionserver.HRegion(1603): Closing 3a9c07b23e5c3de2995af33ec5953d79, disabling compactions & flushes 2023-02-13 04:04:03,848 INFO [Listener at localhost/36569] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:03,848 DEBUG [Listener at localhost/36569] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:03,848 DEBUG [Listener at localhost/36569] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. after waiting 0 ms 2023-02-13 04:04:03,849 DEBUG [Listener at localhost/36569] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:03,849 INFO [Listener at localhost/36569] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:03,849 DEBUG [Listener at localhost/36569] regionserver.HRegion(1557): Region close journal for 3a9c07b23e5c3de2995af33ec5953d79: Waiting for close lock at 1676261043847Disabling compacts and flushes for region at 1676261043847Disabling writes for close at 1676261043849 (+2 ms)Writing region close event to WAL at 1676261043849Closed at 1676261043849 2023-02-13 04:04:03,850 DEBUG [Listener at localhost/36569] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,850 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:03,851 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:03,856 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:04:03,857 DEBUG [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1 2023-02-13 04:04:03,857 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7d7f715b522aafb4baaea641912f48a columnFamilyName f1 2023-02-13 04:04:03,862 DEBUG [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/testWithMockedMapReduceMultiRegion=c7d7f715b522aafb4baaea641912f48a-548368985bf8428baae1a0360eebff20 2023-02-13 04:04:03,862 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] regionserver.HStore(310): Store=c7d7f715b522aafb4baaea641912f48a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,862 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:04:03,863 DEBUG [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2 2023-02-13 04:04:03,863 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7d7f715b522aafb4baaea641912f48a columnFamilyName f2 2023-02-13 04:04:03,866 DEBUG [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/testWithMockedMapReduceMultiRegion=c7d7f715b522aafb4baaea641912f48a-a8b8302554a3419c900a45b1307f1099 2023-02-13 04:04:03,867 INFO [StoreOpener-c7d7f715b522aafb4baaea641912f48a-1] regionserver.HStore(310): Store=c7d7f715b522aafb4baaea641912f48a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,867 DEBUG [Listener at localhost/36569] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:03,867 INFO [Listener at localhost/36569] regionserver.HRegion(1071): Opened c7d7f715b522aafb4baaea641912f48a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72209594, jitterRate=0.07600679993629456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:03,867 DEBUG [Listener at localhost/36569] regionserver.HRegion(964): Region open journal for c7d7f715b522aafb4baaea641912f48a: Writing region info on filesystem at 1676261043851Initializing all the Stores at 1676261043852 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043852Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043855 (+3 ms)Region opened successfully at 1676261043867 (+12 ms) 2023-02-13 04:04:03,875 DEBUG [Listener at localhost/36569] regionserver.HRegion(1603): Closing c7d7f715b522aafb4baaea641912f48a, disabling compactions & flushes 2023-02-13 04:04:03,876 INFO [Listener at localhost/36569] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:03,876 DEBUG [Listener at localhost/36569] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:03,876 DEBUG [Listener at localhost/36569] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. after waiting 0 ms 2023-02-13 04:04:03,876 DEBUG [Listener at localhost/36569] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:03,876 INFO [Listener at localhost/36569] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:03,876 DEBUG [Listener at localhost/36569] regionserver.HRegion(1557): Region close journal for c7d7f715b522aafb4baaea641912f48a: Waiting for close lock at 1676261043875Disabling compacts and flushes for region at 1676261043875Disabling writes for close at 1676261043876 (+1 ms)Writing region close event to WAL at 1676261043876Closed at 1676261043876 2023-02-13 04:04:03,877 DEBUG [Listener at localhost/36569] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,877 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:03,881 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:03,883 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:04:03,885 DEBUG [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/f1 2023-02-13 04:04:03,885 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84863e66b3da719eb4cb244e7c2cb3b2 columnFamilyName f1 2023-02-13 04:04:03,885 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] regionserver.HStore(310): Store=84863e66b3da719eb4cb244e7c2cb3b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,885 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:04:03,886 DEBUG [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/f2 2023-02-13 04:04:03,887 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84863e66b3da719eb4cb244e7c2cb3b2 columnFamilyName f2 2023-02-13 04:04:03,887 INFO [StoreOpener-84863e66b3da719eb4cb244e7c2cb3b2-1] regionserver.HStore(310): Store=84863e66b3da719eb4cb244e7c2cb3b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,887 DEBUG [Listener at localhost/36569] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:03,887 INFO [Listener at localhost/36569] regionserver.HRegion(1071): Opened 84863e66b3da719eb4cb244e7c2cb3b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61320874, jitterRate=-0.0862477719783783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:03,887 DEBUG [Listener at localhost/36569] regionserver.HRegion(964): Region open journal for 84863e66b3da719eb4cb244e7c2cb3b2: Writing region info on filesystem at 1676261043881Initializing all the Stores at 1676261043882 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043882Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043883 (+1 ms)Region opened successfully at 1676261043887 (+4 ms) 2023-02-13 04:04:03,888 DEBUG [Listener at localhost/36569] regionserver.HRegion(1603): Closing 84863e66b3da719eb4cb244e7c2cb3b2, disabling compactions & flushes 2023-02-13 04:04:03,888 INFO [Listener at localhost/36569] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:03,888 DEBUG [Listener at localhost/36569] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:03,888 DEBUG [Listener at localhost/36569] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. after waiting 0 ms 2023-02-13 04:04:03,888 DEBUG [Listener at localhost/36569] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:03,888 INFO [Listener at localhost/36569] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:03,888 DEBUG [Listener at localhost/36569] regionserver.HRegion(1557): Region close journal for 84863e66b3da719eb4cb244e7c2cb3b2: Waiting for close lock at 1676261043888Disabling compacts and flushes for region at 1676261043888Disabling writes for close at 1676261043888Writing region close event to WAL at 1676261043888Closed at 1676261043888 2023-02-13 04:04:03,889 DEBUG [Listener at localhost/36569] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,889 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:03,893 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:03,897 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:04:03,897 DEBUG [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1 2023-02-13 04:04:03,898 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 902e265a9f837f8af40e96b35cfc9f67 columnFamilyName f1 2023-02-13 04:04:03,902 DEBUG [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/testWithMockedMapReduceMultiRegion=902e265a9f837f8af40e96b35cfc9f67-a0ad40c35b0e409c85fd086b83848cec 2023-02-13 04:04:03,902 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] regionserver.HStore(310): Store=902e265a9f837f8af40e96b35cfc9f67/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,902 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:04:03,903 DEBUG [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2 2023-02-13 04:04:03,903 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 902e265a9f837f8af40e96b35cfc9f67 columnFamilyName f2 2023-02-13 04:04:03,911 DEBUG [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/testWithMockedMapReduceMultiRegion=902e265a9f837f8af40e96b35cfc9f67-3ffc804d7ad0424c9f2dfe088b835333 2023-02-13 04:04:03,911 INFO [StoreOpener-902e265a9f837f8af40e96b35cfc9f67-1] regionserver.HStore(310): Store=902e265a9f837f8af40e96b35cfc9f67/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,911 DEBUG [Listener at localhost/36569] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:03,911 INFO [Listener at localhost/36569] regionserver.HRegion(1071): Opened 902e265a9f837f8af40e96b35cfc9f67; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71505193, jitterRate=0.06551040709018707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:03,911 DEBUG [Listener at localhost/36569] regionserver.HRegion(964): Region open journal for 902e265a9f837f8af40e96b35cfc9f67: Writing region info on filesystem at 1676261043893Initializing all the Stores at 1676261043893Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043893Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043896 (+3 ms)Region opened successfully at 1676261043911 (+15 ms) 2023-02-13 04:04:03,920 DEBUG [Listener at localhost/36569] regionserver.HRegion(1603): Closing 902e265a9f837f8af40e96b35cfc9f67, disabling compactions & flushes 2023-02-13 04:04:03,920 INFO [Listener at localhost/36569] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:03,920 DEBUG [Listener at localhost/36569] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:03,920 DEBUG [Listener at localhost/36569] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. after waiting 0 ms 2023-02-13 04:04:03,920 DEBUG [Listener at localhost/36569] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:03,921 INFO [Listener at localhost/36569] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:03,921 DEBUG [Listener at localhost/36569] regionserver.HRegion(1557): Region close journal for 902e265a9f837f8af40e96b35cfc9f67: Waiting for close lock at 1676261043920Disabling compacts and flushes for region at 1676261043920Disabling writes for close at 1676261043920Writing region close event to WAL at 1676261043921 (+1 ms)Closed at 1676261043921 2023-02-13 04:04:03,921 DEBUG [Listener at localhost/36569] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,921 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:03,923 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:03,924 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 81c803a453213180a0941d1de82923f8 2023-02-13 04:04:03,925 DEBUG [StoreOpener-81c803a453213180a0941d1de82923f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1 2023-02-13 04:04:03,925 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81c803a453213180a0941d1de82923f8 columnFamilyName f1 2023-02-13 04:04:03,929 DEBUG [StoreOpener-81c803a453213180a0941d1de82923f8-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/testWithMockedMapReduceMultiRegion=81c803a453213180a0941d1de82923f8-c60d61e6262242fc84a3695c6f46af40 2023-02-13 04:04:03,929 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] regionserver.HStore(310): Store=81c803a453213180a0941d1de82923f8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,929 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 81c803a453213180a0941d1de82923f8 2023-02-13 04:04:03,930 DEBUG [StoreOpener-81c803a453213180a0941d1de82923f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2 2023-02-13 04:04:03,930 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81c803a453213180a0941d1de82923f8 columnFamilyName f2 2023-02-13 04:04:03,933 DEBUG [StoreOpener-81c803a453213180a0941d1de82923f8-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/testWithMockedMapReduceMultiRegion=81c803a453213180a0941d1de82923f8-3769dfd8d46f4565829fa13f82b42f9c 2023-02-13 04:04:03,933 INFO [StoreOpener-81c803a453213180a0941d1de82923f8-1] regionserver.HStore(310): Store=81c803a453213180a0941d1de82923f8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,933 DEBUG [Listener at localhost/36569] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:03,934 INFO [Listener at localhost/36569] regionserver.HRegion(1071): Opened 81c803a453213180a0941d1de82923f8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62748578, jitterRate=-0.06497332453727722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:03,934 DEBUG [Listener at localhost/36569] regionserver.HRegion(964): Region open journal for 81c803a453213180a0941d1de82923f8: Writing region info on filesystem at 1676261043923Initializing all the Stores at 1676261043923Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043923Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043923Region opened successfully at 1676261043934 (+11 ms) 2023-02-13 04:04:03,941 DEBUG [Listener at localhost/36569] regionserver.HRegion(1603): Closing 81c803a453213180a0941d1de82923f8, disabling compactions & flushes 2023-02-13 04:04:03,941 INFO [Listener at localhost/36569] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:03,941 DEBUG [Listener at localhost/36569] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:03,941 DEBUG [Listener at localhost/36569] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. after waiting 0 ms 2023-02-13 04:04:03,942 DEBUG [Listener at localhost/36569] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:03,942 INFO [Listener at localhost/36569] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:03,942 DEBUG [Listener at localhost/36569] regionserver.HRegion(1557): Region close journal for 81c803a453213180a0941d1de82923f8: Waiting for close lock at 1676261043941Disabling compacts and flushes for region at 1676261043941Disabling writes for close at 1676261043942 (+1 ms)Writing region close event to WAL at 1676261043942Closed at 1676261043942 2023-02-13 04:04:03,943 DEBUG [Listener at localhost/36569] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:03,943 INFO [Listener at localhost/36569] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:03,944 DEBUG [Listener at localhost/36569] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:03,946 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:04:03,947 DEBUG [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1 2023-02-13 04:04:03,947 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12b5f46153081cbbe23dc6da7d51da12 columnFamilyName f1 2023-02-13 04:04:03,951 DEBUG [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/testWithMockedMapReduceMultiRegion=12b5f46153081cbbe23dc6da7d51da12-7eca6a2fb5a14391a2f313ba03a67ffd 2023-02-13 04:04:03,951 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] regionserver.HStore(310): Store=12b5f46153081cbbe23dc6da7d51da12/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,951 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:04:03,952 DEBUG [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2 2023-02-13 04:04:03,952 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 12b5f46153081cbbe23dc6da7d51da12 columnFamilyName f2 2023-02-13 04:04:03,956 DEBUG [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] regionserver.HStore(539): loaded hdfs://localhost:46273/user/jenkins/test-data/04a9fde6-8076-c20f-f8d3-6d778afd8393/testWithMockedMapReduceMultiRegion/f7db06d2-6b28-4bea-bdaf-20cc700e5027/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/testWithMockedMapReduceMultiRegion=12b5f46153081cbbe23dc6da7d51da12-2fb0c4bf53ef4f0390222f2af1824d3d 2023-02-13 04:04:03,956 INFO [StoreOpener-12b5f46153081cbbe23dc6da7d51da12-1] regionserver.HStore(310): Store=12b5f46153081cbbe23dc6da7d51da12/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:03,956 DEBUG [Listener at localhost/36569] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:03,956 INFO [Listener at localhost/36569] regionserver.HRegion(1071): Opened 12b5f46153081cbbe23dc6da7d51da12; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61685940, jitterRate=-0.08080786466598511}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:03,957 DEBUG [Listener at localhost/36569] regionserver.HRegion(964): Region open journal for 12b5f46153081cbbe23dc6da7d51da12: Writing region info on filesystem at 1676261043944Initializing all the Stores at 1676261043945 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043945Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261043945Region opened successfully at 1676261043957 (+12 ms) 2023-02-13 04:04:03,966 DEBUG [Listener at localhost/36569] regionserver.HRegion(1603): Closing 12b5f46153081cbbe23dc6da7d51da12, disabling compactions & flushes 2023-02-13 04:04:03,966 INFO [Listener at localhost/36569] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:03,966 DEBUG [Listener at localhost/36569] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:03,966 DEBUG [Listener at localhost/36569] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. after waiting 0 ms 2023-02-13 04:04:03,966 DEBUG [Listener at localhost/36569] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:03,967 INFO [Listener at localhost/36569] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:03,967 DEBUG [Listener at localhost/36569] regionserver.HRegion(1557): Region close journal for 12b5f46153081cbbe23dc6da7d51da12: Waiting for close lock at 1676261043966Disabling compacts and flushes for region at 1676261043966Disabling writes for close at 1676261043966Writing region close event to WAL at 1676261043967 (+1 ms)Closed at 1676261043967 2023-02-13 04:04:03,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-13 04:04:03,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-13 04:04:03,974 INFO [Listener at localhost/36569] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-13 04:04:03,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-13 04:04:03,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:03,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 04:04:03,978 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261043978"}]},"ts":"1676261043978"} 2023-02-13 04:04:03,979 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-13 04:04:03,981 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-13 04:04:03,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84863e66b3da719eb4cb244e7c2cb3b2, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0560d2e09b5461c5d897c728ec0fb2e0, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81c803a453213180a0941d1de82923f8, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=23600bfb9489de77511b8919349ae24b, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7d7f715b522aafb4baaea641912f48a, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a9c07b23e5c3de2995af33ec5953d79, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=902e265a9f837f8af40e96b35cfc9f67, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e339c1446ecfe4a1580a9251f12d5ef, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12b5f46153081cbbe23dc6da7d51da12, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=11582139dfb10d92dc5b9f056cb10216, UNASSIGN}] 2023-02-13 04:04:03,984 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81c803a453213180a0941d1de82923f8, UNASSIGN 2023-02-13 04:04:03,984 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=11582139dfb10d92dc5b9f056cb10216, UNASSIGN 2023-02-13 04:04:03,984 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84863e66b3da719eb4cb244e7c2cb3b2, UNASSIGN 2023-02-13 04:04:03,984 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0560d2e09b5461c5d897c728ec0fb2e0, UNASSIGN 2023-02-13 04:04:03,984 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=23600bfb9489de77511b8919349ae24b, UNASSIGN 2023-02-13 04:04:03,985 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=81c803a453213180a0941d1de82923f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:03,985 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676261038920.81c803a453213180a0941d1de82923f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261043985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261043985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261043985"}]},"ts":"1676261043985"} 2023-02-13 04:04:03,985 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=11582139dfb10d92dc5b9f056cb10216, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:03,985 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=23600bfb9489de77511b8919349ae24b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:03,985 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676261043985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261043985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261043985"}]},"ts":"1676261043985"} 2023-02-13 04:04:03,985 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=84863e66b3da719eb4cb244e7c2cb3b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:03,985 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=0560d2e09b5461c5d897c728ec0fb2e0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:03,985 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261043985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261043985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261043985"}]},"ts":"1676261043985"} 2023-02-13 04:04:03,985 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676261043985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261043985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261043985"}]},"ts":"1676261043985"} 2023-02-13 04:04:03,985 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261043985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261043985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261043985"}]},"ts":"1676261043985"} 2023-02-13 04:04:03,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure 81c803a453213180a0941d1de82923f8, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:04:03,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; CloseRegionProcedure 11582139dfb10d92dc5b9f056cb10216, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:04:03,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=35, state=RUNNABLE; CloseRegionProcedure 0560d2e09b5461c5d897c728ec0fb2e0, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:04:03,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=34, state=RUNNABLE; CloseRegionProcedure 84863e66b3da719eb4cb244e7c2cb3b2, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:04:03,989 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=37, state=RUNNABLE; CloseRegionProcedure 23600bfb9489de77511b8919349ae24b, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:04:03,989 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12b5f46153081cbbe23dc6da7d51da12, UNASSIGN 2023-02-13 04:04:03,989 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e339c1446ecfe4a1580a9251f12d5ef, UNASSIGN 2023-02-13 04:04:03,989 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=12b5f46153081cbbe23dc6da7d51da12, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:03,990 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261043989"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261043989"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261043989"}]},"ts":"1676261043989"} 2023-02-13 04:04:03,990 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=902e265a9f837f8af40e96b35cfc9f67, UNASSIGN 2023-02-13 04:04:03,990 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=5e339c1446ecfe4a1580a9251f12d5ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:03,990 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=902e265a9f837f8af40e96b35cfc9f67, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:03,990 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261043990"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261043990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261043990"}]},"ts":"1676261043990"} 2023-02-13 04:04:03,991 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261043990"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261043990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261043990"}]},"ts":"1676261043990"} 2023-02-13 04:04:03,990 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a9c07b23e5c3de2995af33ec5953d79, UNASSIGN 2023-02-13 04:04:03,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 12b5f46153081cbbe23dc6da7d51da12, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:04:03,992 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=3a9c07b23e5c3de2995af33ec5953d79, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:03,992 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7d7f715b522aafb4baaea641912f48a, UNASSIGN 2023-02-13 04:04:03,992 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261043992"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261043992"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261043992"}]},"ts":"1676261043992"} 2023-02-13 04:04:03,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 5e339c1446ecfe4a1580a9251f12d5ef, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:04:03,993 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c7d7f715b522aafb4baaea641912f48a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:03,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 902e265a9f837f8af40e96b35cfc9f67, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:04:03,993 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261043993"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261043993"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261043993"}]},"ts":"1676261043993"} 2023-02-13 04:04:03,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 3a9c07b23e5c3de2995af33ec5953d79, server=jenkins-hbase4.apache.org,41381,1676261037649}] 2023-02-13 04:04:03,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure c7d7f715b522aafb4baaea641912f48a, server=jenkins-hbase4.apache.org,39517,1676261037674}] 2023-02-13 04:04:04,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 04:04:04,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:04:04,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 902e265a9f837f8af40e96b35cfc9f67, disabling compactions & flushes 2023-02-13 04:04:04,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:04,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:04,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. after waiting 0 ms 2023-02-13 04:04:04,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:04,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:04:04,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3a9c07b23e5c3de2995af33ec5953d79, disabling compactions & flushes 2023-02-13 04:04:04,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:04,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:04,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. after waiting 0 ms 2023-02-13 04:04:04,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:04,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:04,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:04,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67. 2023-02-13 04:04:04,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 902e265a9f837f8af40e96b35cfc9f67: Waiting for close lock at 1676261044138Running coprocessor pre-close hooks at 1676261044138Disabling compacts and flushes for region at 1676261044138Disabling writes for close at 1676261044138Writing region close event to WAL at 1676261044139 (+1 ms)Running coprocessor post-close hooks at 1676261044142 (+3 ms)Closed at 1676261044142 2023-02-13 04:04:04,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79. 2023-02-13 04:04:04,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3a9c07b23e5c3de2995af33ec5953d79: Waiting for close lock at 1676261044139Running coprocessor pre-close hooks at 1676261044139Disabling compacts and flushes for region at 1676261044139Disabling writes for close at 1676261044139Writing region close event to WAL at 1676261044140 (+1 ms)Running coprocessor post-close hooks at 1676261044142 (+2 ms)Closed at 1676261044142 2023-02-13 04:04:04,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:04:04,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 23600bfb9489de77511b8919349ae24b 2023-02-13 04:04:04,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 23600bfb9489de77511b8919349ae24b, disabling compactions & flushes 2023-02-13 04:04:04,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:04,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:04,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. after waiting 0 ms 2023-02-13 04:04:04,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:04,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=3a9c07b23e5c3de2995af33ec5953d79, regionState=CLOSED 2023-02-13 04:04:04,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261044144"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261044144"}]},"ts":"1676261044144"} 2023-02-13 04:04:04,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:04:04,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:04:04,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0560d2e09b5461c5d897c728ec0fb2e0, disabling compactions & flushes 2023-02-13 04:04:04,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:04,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:04,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. after waiting 0 ms 2023-02-13 04:04:04,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:04,147 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=902e265a9f837f8af40e96b35cfc9f67, regionState=CLOSED 2023-02-13 04:04:04,147 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261044147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261044147"}]},"ts":"1676261044147"} 2023-02-13 04:04:04,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-13 04:04:04,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 3a9c07b23e5c3de2995af33ec5953d79, server=jenkins-hbase4.apache.org,41381,1676261037649 in 152 msec 2023-02-13 04:04:04,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3a9c07b23e5c3de2995af33ec5953d79, UNASSIGN in 166 msec 2023-02-13 04:04:04,151 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 04:04:04,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-13 04:04:04,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 902e265a9f837f8af40e96b35cfc9f67, server=jenkins-hbase4.apache.org,39517,1676261037674 in 156 msec 2023-02-13 04:04:04,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=902e265a9f837f8af40e96b35cfc9f67, UNASSIGN in 170 msec 2023-02-13 04:04:04,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:04,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0. 2023-02-13 04:04:04,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0560d2e09b5461c5d897c728ec0fb2e0: Waiting for close lock at 1676261044145Running coprocessor pre-close hooks at 1676261044145Disabling compacts and flushes for region at 1676261044145Disabling writes for close at 1676261044145Writing region close event to WAL at 1676261044148 (+3 ms)Running coprocessor post-close hooks at 1676261044157 (+9 ms)Closed at 1676261044157 2023-02-13 04:04:04,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:04:04,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:04:04,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5e339c1446ecfe4a1580a9251f12d5ef, disabling compactions & flushes 2023-02-13 04:04:04,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:04,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:04,158 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=0560d2e09b5461c5d897c728ec0fb2e0, regionState=CLOSED 2023-02-13 04:04:04,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. after waiting 0 ms 2023-02-13 04:04:04,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:04,158 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261044158"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261044158"}]},"ts":"1676261044158"} 2023-02-13 04:04:04,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=35 2023-02-13 04:04:04,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=35, state=SUCCESS; CloseRegionProcedure 0560d2e09b5461c5d897c728ec0fb2e0, server=jenkins-hbase4.apache.org,39517,1676261037674 in 173 msec 2023-02-13 04:04:04,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0560d2e09b5461c5d897c728ec0fb2e0, UNASSIGN in 179 msec 2023-02-13 04:04:04,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:04,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b. 2023-02-13 04:04:04,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 23600bfb9489de77511b8919349ae24b: Waiting for close lock at 1676261044144Running coprocessor pre-close hooks at 1676261044144Disabling compacts and flushes for region at 1676261044144Disabling writes for close at 1676261044144Writing region close event to WAL at 1676261044146 (+2 ms)Running coprocessor post-close hooks at 1676261044163 (+17 ms)Closed at 1676261044163 2023-02-13 04:04:04,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 23600bfb9489de77511b8919349ae24b 2023-02-13 04:04:04,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:04:04,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 11582139dfb10d92dc5b9f056cb10216, disabling compactions & flushes 2023-02-13 04:04:04,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:04,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:04,170 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=23600bfb9489de77511b8919349ae24b, regionState=CLOSED 2023-02-13 04:04:04,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:04,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. after waiting 0 ms 2023-02-13 04:04:04,170 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261044170"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261044170"}]},"ts":"1676261044170"} 2023-02-13 04:04:04,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:04,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef. 2023-02-13 04:04:04,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5e339c1446ecfe4a1580a9251f12d5ef: Waiting for close lock at 1676261044158Running coprocessor pre-close hooks at 1676261044158Disabling compacts and flushes for region at 1676261044158Disabling writes for close at 1676261044158Writing region close event to WAL at 1676261044163 (+5 ms)Running coprocessor post-close hooks at 1676261044171 (+8 ms)Closed at 1676261044171 2023-02-13 04:04:04,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:04:04,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 81c803a453213180a0941d1de82923f8 2023-02-13 04:04:04,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 81c803a453213180a0941d1de82923f8, disabling compactions & flushes 2023-02-13 04:04:04,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:04,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:04,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. after waiting 0 ms 2023-02-13 04:04:04,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:04,173 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=5e339c1446ecfe4a1580a9251f12d5ef, regionState=CLOSED 2023-02-13 04:04:04,173 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261044173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261044173"}]},"ts":"1676261044173"} 2023-02-13 04:04:04,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=37 2023-02-13 04:04:04,174 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=37, state=SUCCESS; CloseRegionProcedure 23600bfb9489de77511b8919349ae24b, server=jenkins-hbase4.apache.org,41381,1676261037649 in 183 msec 2023-02-13 04:04:04,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=23600bfb9489de77511b8919349ae24b, UNASSIGN in 192 msec 2023-02-13 04:04:04,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-13 04:04:04,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 5e339c1446ecfe4a1580a9251f12d5ef, server=jenkins-hbase4.apache.org,39517,1676261037674 in 182 msec 2023-02-13 04:04:04,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 04:04:04,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216. 2023-02-13 04:04:04,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 11582139dfb10d92dc5b9f056cb10216: Waiting for close lock at 1676261044170Running coprocessor pre-close hooks at 1676261044170Disabling compacts and flushes for region at 1676261044170Disabling writes for close at 1676261044170Writing region close event to WAL at 1676261044171 (+1 ms)Running coprocessor post-close hooks at 1676261044176 (+5 ms)Closed at 1676261044176 2023-02-13 04:04:04,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5e339c1446ecfe4a1580a9251f12d5ef, UNASSIGN in 194 msec 2023-02-13 04:04:04,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:04:04,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:04:04,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 84863e66b3da719eb4cb244e7c2cb3b2, disabling compactions & flushes 2023-02-13 04:04:04,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:04,178 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=11582139dfb10d92dc5b9f056cb10216, regionState=CLOSED 2023-02-13 04:04:04,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:04,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. after waiting 0 ms 2023-02-13 04:04:04,178 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676261044178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261044178"}]},"ts":"1676261044178"} 2023-02-13 04:04:04,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:04,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-02-13 04:04:04,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; CloseRegionProcedure 11582139dfb10d92dc5b9f056cb10216, server=jenkins-hbase4.apache.org,41381,1676261037649 in 192 msec 2023-02-13 04:04:04,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=11582139dfb10d92dc5b9f056cb10216, UNASSIGN in 199 msec 2023-02-13 04:04:04,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:04,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 04:04:04,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8. 2023-02-13 04:04:04,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 81c803a453213180a0941d1de82923f8: Waiting for close lock at 1676261044173Running coprocessor pre-close hooks at 1676261044173Disabling compacts and flushes for region at 1676261044173Disabling writes for close at 1676261044173Writing region close event to WAL at 1676261044180 (+7 ms)Running coprocessor post-close hooks at 1676261044184 (+4 ms)Closed at 1676261044184 2023-02-13 04:04:04,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2. 2023-02-13 04:04:04,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 84863e66b3da719eb4cb244e7c2cb3b2: Waiting for close lock at 1676261044178Running coprocessor pre-close hooks at 1676261044178Disabling compacts and flushes for region at 1676261044178Disabling writes for close at 1676261044178Writing region close event to WAL at 1676261044180 (+2 ms)Running coprocessor post-close hooks at 1676261044184 (+4 ms)Closed at 1676261044184 2023-02-13 04:04:04,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 81c803a453213180a0941d1de82923f8 2023-02-13 04:04:04,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:04:04,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c7d7f715b522aafb4baaea641912f48a, disabling compactions & flushes 2023-02-13 04:04:04,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:04,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:04,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. after waiting 0 ms 2023-02-13 04:04:04,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:04,188 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=81c803a453213180a0941d1de82923f8, regionState=CLOSED 2023-02-13 04:04:04,188 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676261038920.81c803a453213180a0941d1de82923f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261044188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261044188"}]},"ts":"1676261044188"} 2023-02-13 04:04:04,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:04:04,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:04:04,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 12b5f46153081cbbe23dc6da7d51da12, disabling compactions & flushes 2023-02-13 04:04:04,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:04,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:04,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. after waiting 0 ms 2023-02-13 04:04:04,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:04,188 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=84863e66b3da719eb4cb244e7c2cb3b2, regionState=CLOSED 2023-02-13 04:04:04,188 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676261044188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261044188"}]},"ts":"1676261044188"} 2023-02-13 04:04:04,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-13 04:04:04,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure 81c803a453213180a0941d1de82923f8, server=jenkins-hbase4.apache.org,39517,1676261037674 in 203 msec 2023-02-13 04:04:04,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=34 2023-02-13 04:04:04,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=34, state=SUCCESS; CloseRegionProcedure 84863e66b3da719eb4cb244e7c2cb3b2, server=jenkins-hbase4.apache.org,41381,1676261037649 in 202 msec 2023-02-13 04:04:04,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=81c803a453213180a0941d1de82923f8, UNASSIGN in 209 msec 2023-02-13 04:04:04,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=84863e66b3da719eb4cb244e7c2cb3b2, UNASSIGN in 214 msec 2023-02-13 04:04:04,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:04,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:04,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12. 2023-02-13 04:04:04,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 12b5f46153081cbbe23dc6da7d51da12: Waiting for close lock at 1676261044188Running coprocessor pre-close hooks at 1676261044188Disabling compacts and flushes for region at 1676261044188Disabling writes for close at 1676261044188Writing region close event to WAL at 1676261044203 (+15 ms)Running coprocessor post-close hooks at 1676261044207 (+4 ms)Closed at 1676261044207 2023-02-13 04:04:04,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a. 2023-02-13 04:04:04,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c7d7f715b522aafb4baaea641912f48a: Waiting for close lock at 1676261044185Running coprocessor pre-close hooks at 1676261044185Disabling compacts and flushes for region at 1676261044185Disabling writes for close at 1676261044185Writing region close event to WAL at 1676261044202 (+17 ms)Running coprocessor post-close hooks at 1676261044208 (+6 ms)Closed at 1676261044209 (+1 ms) 2023-02-13 04:04:04,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:04:04,212 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=12b5f46153081cbbe23dc6da7d51da12, regionState=CLOSED 2023-02-13 04:04:04,212 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261044212"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261044212"}]},"ts":"1676261044212"} 2023-02-13 04:04:04,213 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c7d7f715b522aafb4baaea641912f48a, regionState=CLOSED 2023-02-13 04:04:04,213 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676261044213"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261044213"}]},"ts":"1676261044213"} 2023-02-13 04:04:04,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:04:04,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-13 04:04:04,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 12b5f46153081cbbe23dc6da7d51da12, server=jenkins-hbase4.apache.org,41381,1676261037649 in 223 msec 2023-02-13 04:04:04,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-13 04:04:04,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=12b5f46153081cbbe23dc6da7d51da12, UNASSIGN in 234 msec 2023-02-13 04:04:04,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure c7d7f715b522aafb4baaea641912f48a, server=jenkins-hbase4.apache.org,39517,1676261037674 in 218 msec 2023-02-13 04:04:04,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-13 04:04:04,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7d7f715b522aafb4baaea641912f48a, UNASSIGN in 236 msec 2023-02-13 04:04:04,220 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261044220"}]},"ts":"1676261044220"} 2023-02-13 04:04:04,221 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-13 04:04:04,224 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-13 04:04:04,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 249 msec 2023-02-13 04:04:04,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 04:04:04,281 INFO [Listener at localhost/36569] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-13 04:04:04,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-13 04:04:04,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:04,285 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:04,285 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:04,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 04:04:04,297 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:04:04,297 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8 2023-02-13 04:04:04,297 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:04:04,297 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:04:04,297 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:04:04,297 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:04:04,297 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b 2023-02-13 04:04:04,297 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:04:04,302 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/recovered.edits] 2023-02-13 04:04:04,302 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/f1, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/f2, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/recovered.edits] 2023-02-13 04:04:04,302 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/recovered.edits] 2023-02-13 04:04:04,302 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/recovered.edits] 2023-02-13 04:04:04,303 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/recovered.edits] 2023-02-13 04:04:04,303 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/recovered.edits] 2023-02-13 04:04:04,303 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/recovered.edits] 2023-02-13 04:04:04,303 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/recovered.edits] 2023-02-13 04:04:04,310 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/c52fd3212cb24fbcb6bf38fb06ff65f0 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/c52fd3212cb24fbcb6bf38fb06ff65f0 2023-02-13 04:04:04,310 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/30126be5a10c40a3afbe48222d00a863 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/30126be5a10c40a3afbe48222d00a863 2023-02-13 04:04:04,313 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/a5ee7d1691f4451fb7146c7fbbc17fff to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/a5ee7d1691f4451fb7146c7fbbc17fff 2023-02-13 04:04:04,314 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/32e0ac4b680b4594b0714f05a3ccd8db to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/32e0ac4b680b4594b0714f05a3ccd8db 2023-02-13 04:04:04,314 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/4b15c3abd4cd4421a98f6053bfb4e4ca to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/4b15c3abd4cd4421a98f6053bfb4e4ca 2023-02-13 04:04:04,314 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/e28b427b921f4bebb82a3fd166626bf8 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f1/e28b427b921f4bebb82a3fd166626bf8 2023-02-13 04:04:04,315 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/548368985bf8428baae1a0360eebff20 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/548368985bf8428baae1a0360eebff20 2023-02-13 04:04:04,315 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/54e2f0629e864a3b92414640a073c6bc to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f1/54e2f0629e864a3b92414640a073c6bc 2023-02-13 04:04:04,315 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/8c20c3ff1d294bd7934b8ff35bd890eb to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/8c20c3ff1d294bd7934b8ff35bd890eb 2023-02-13 04:04:04,316 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/ff2c17d787ae48268eae9db1288b5f4d to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f1/ff2c17d787ae48268eae9db1288b5f4d 2023-02-13 04:04:04,316 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/recovered.edits/6.seqid to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2/recovered.edits/6.seqid 2023-02-13 04:04:04,317 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/c60d61e6262242fc84a3695c6f46af40 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f1/c60d61e6262242fc84a3695c6f46af40 2023-02-13 04:04:04,317 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/84863e66b3da719eb4cb244e7c2cb3b2 2023-02-13 04:04:04,317 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:04:04,318 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/994dc84a1d634e598c14356201ec14b0 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f1/994dc84a1d634e598c14356201ec14b0 2023-02-13 04:04:04,318 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/e7a9602b04a741d88dfaf6ca58bedf02 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f1/e7a9602b04a741d88dfaf6ca58bedf02 2023-02-13 04:04:04,319 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/a0ad40c35b0e409c85fd086b83848cec to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f1/a0ad40c35b0e409c85fd086b83848cec 2023-02-13 04:04:04,321 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/b26bbb81e42e49d3990017cc80cf4eab to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/b26bbb81e42e49d3990017cc80cf4eab 2023-02-13 04:04:04,322 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/b5b976a7bd734eb1b0ffd2cc8a977662 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/b5b976a7bd734eb1b0ffd2cc8a977662 2023-02-13 04:04:04,322 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/recovered.edits] 2023-02-13 04:04:04,323 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/83d1689f9448411bbf2aff96f7445551 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/83d1689f9448411bbf2aff96f7445551 2023-02-13 04:04:04,324 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/a8b8302554a3419c900a45b1307f1099 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/a8b8302554a3419c900a45b1307f1099 2023-02-13 04:04:04,324 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/1d6d144b6631411caa6935371b480113 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/1d6d144b6631411caa6935371b480113 2023-02-13 04:04:04,324 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/3769dfd8d46f4565829fa13f82b42f9c to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/3769dfd8d46f4565829fa13f82b42f9c 2023-02-13 04:04:04,325 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/bf1c819bfe3a4b389dfc5b5b2c3f3ae0 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/f2/bf1c819bfe3a4b389dfc5b5b2c3f3ae0 2023-02-13 04:04:04,325 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/bafddc6e82b34b959f5c67f7a961a813 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/f2/bafddc6e82b34b959f5c67f7a961a813 2023-02-13 04:04:04,327 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/64ccffc4ccd74a98a9548b472f866483 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/f2/64ccffc4ccd74a98a9548b472f866483 2023-02-13 04:04:04,327 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/3ffc804d7ad0424c9f2dfe088b835333 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/3ffc804d7ad0424c9f2dfe088b835333 2023-02-13 04:04:04,327 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/e1c67816b3f94a36b5584d336d4f0bc4 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/f2/e1c67816b3f94a36b5584d336d4f0bc4 2023-02-13 04:04:04,327 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/a9789d2a73724ca8a024ff83d22e0048 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/f2/a9789d2a73724ca8a024ff83d22e0048 2023-02-13 04:04:04,328 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/c23c3f3640494b35aa1579b992649b14 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/f2/c23c3f3640494b35aa1579b992649b14 2023-02-13 04:04:04,330 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/19f26777e424471fa50b9f4b8917547a to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/19f26777e424471fa50b9f4b8917547a 2023-02-13 04:04:04,331 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/a23f4832d3c049988263ef68e38521a3 to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/f2/a23f4832d3c049988263ef68e38521a3 2023-02-13 04:04:04,333 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/7eca6a2fb5a14391a2f313ba03a67ffd to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f1/7eca6a2fb5a14391a2f313ba03a67ffd 2023-02-13 04:04:04,333 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/recovered.edits/12.seqid to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b/recovered.edits/12.seqid 2023-02-13 04:04:04,334 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/recovered.edits/12.seqid to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79/recovered.edits/12.seqid 2023-02-13 04:04:04,335 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/recovered.edits/12.seqid to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8/recovered.edits/12.seqid 2023-02-13 04:04:04,335 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/23600bfb9489de77511b8919349ae24b 2023-02-13 04:04:04,335 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:04:04,335 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/3a9c07b23e5c3de2995af33ec5953d79 2023-02-13 04:04:04,336 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/recovered.edits/12.seqid to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a/recovered.edits/12.seqid 2023-02-13 04:04:04,336 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/81c803a453213180a0941d1de82923f8 2023-02-13 04:04:04,337 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/recovered.edits/12.seqid to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0/recovered.edits/12.seqid 2023-02-13 04:04:04,337 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/recovered.edits/12.seqid to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef/recovered.edits/12.seqid 2023-02-13 04:04:04,337 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7d7f715b522aafb4baaea641912f48a 2023-02-13 04:04:04,338 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/0560d2e09b5461c5d897c728ec0fb2e0 2023-02-13 04:04:04,338 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/5e339c1446ecfe4a1580a9251f12d5ef 2023-02-13 04:04:04,338 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/f1, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/f2, FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/recovered.edits] 2023-02-13 04:04:04,338 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/2a601413de714e6a9b74b61e61f6095c to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/2a601413de714e6a9b74b61e61f6095c 2023-02-13 04:04:04,338 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/recovered.edits/12.seqid to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67/recovered.edits/12.seqid 2023-02-13 04:04:04,339 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/902e265a9f837f8af40e96b35cfc9f67 2023-02-13 04:04:04,340 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/2fb0c4bf53ef4f0390222f2af1824d3d to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/f2/2fb0c4bf53ef4f0390222f2af1824d3d 2023-02-13 04:04:04,343 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/recovered.edits/12.seqid to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12/recovered.edits/12.seqid 2023-02-13 04:04:04,343 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/12b5f46153081cbbe23dc6da7d51da12 2023-02-13 04:04:04,344 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/recovered.edits/6.seqid to hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/archive/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216/recovered.edits/6.seqid 2023-02-13 04:04:04,344 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/.tmp/data/default/testWithMockedMapReduceMultiRegion/11582139dfb10d92dc5b9f056cb10216 2023-02-13 04:04:04,344 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-13 04:04:04,346 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:04,349 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-13 04:04:04,351 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-13 04:04:04,352 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:04,352 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-13 04:04:04,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261044352"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261044352"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676261038920.81c803a453213180a0941d1de82923f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261044352"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261044352"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261044352"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261044352"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261044352"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261044352"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261044352"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261044352"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,355 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-13 04:04:04,355 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 84863e66b3da719eb4cb244e7c2cb3b2, NAME => 'testWithMockedMapReduceMultiRegion,,1676261038920.84863e66b3da719eb4cb244e7c2cb3b2.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 0560d2e09b5461c5d897c728ec0fb2e0, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676261038920.0560d2e09b5461c5d897c728ec0fb2e0.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 81c803a453213180a0941d1de82923f8, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676261038920.81c803a453213180a0941d1de82923f8.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 23600bfb9489de77511b8919349ae24b, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676261038920.23600bfb9489de77511b8919349ae24b.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => c7d7f715b522aafb4baaea641912f48a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676261038920.c7d7f715b522aafb4baaea641912f48a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 3a9c07b23e5c3de2995af33ec5953d79, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676261038920.3a9c07b23e5c3de2995af33ec5953d79.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 902e265a9f837f8af40e96b35cfc9f67, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676261038920.902e265a9f837f8af40e96b35cfc9f67.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 5e339c1446ecfe4a1580a9251f12d5ef, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676261038920.5e339c1446ecfe4a1580a9251f12d5ef.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 12b5f46153081cbbe23dc6da7d51da12, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676261038920.12b5f46153081cbbe23dc6da7d51da12.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 11582139dfb10d92dc5b9f056cb10216, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676261038920.11582139dfb10d92dc5b9f056cb10216.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-13 04:04:04,355 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-13 04:04:04,355 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676261044355"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:04,357 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-13 04:04:04,359 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 04:04:04,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 77 msec 2023-02-13 04:04:04,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 04:04:04,388 INFO [Listener at localhost/36569] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-13 04:04:04,388 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 04:04:04,388 INFO [Listener at localhost/36569] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:04:04,388 DEBUG [Listener at localhost/36569] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28f258e7 to 127.0.0.1:63217 2023-02-13 04:04:04,388 DEBUG [Listener at localhost/36569] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:04,388 DEBUG [Listener at localhost/36569] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 04:04:04,389 DEBUG [Listener at localhost/36569] util.JVMClusterUtil(257): Found active master hash=441686145, stopped=false 2023-02-13 04:04:04,389 INFO [Listener at localhost/36569] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42999,1676261037602 2023-02-13 04:04:04,390 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:04,390 INFO [Listener at localhost/36569] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 04:04:04,390 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:04,391 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:04,390 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:04,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:04,392 DEBUG [Listener at localhost/36569] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x338ef415 to 127.0.0.1:63217 2023-02-13 04:04:04,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:04,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:04,392 DEBUG [Listener at localhost/36569] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:04,393 INFO [Listener at localhost/36569] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41381,1676261037649' ***** 2023-02-13 04:04:04,393 INFO [Listener at localhost/36569] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:04:04,393 INFO [Listener at localhost/36569] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39517,1676261037674' ***** 2023-02-13 04:04:04,393 INFO [Listener at localhost/36569] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:04:04,393 INFO [RS:1;jenkins-hbase4:39517] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:04:04,393 INFO [RS:0;jenkins-hbase4:41381] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:04:04,394 INFO [RS:0;jenkins-hbase4:41381] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:04:04,394 INFO [RS:0;jenkins-hbase4:41381] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:04:04,394 INFO [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:04,394 DEBUG [RS:0;jenkins-hbase4:41381] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10fbf164 to 127.0.0.1:63217 2023-02-13 04:04:04,394 DEBUG [RS:0;jenkins-hbase4:41381] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:04,394 INFO [RS:0;jenkins-hbase4:41381] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:04:04,394 INFO [RS:0;jenkins-hbase4:41381] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:04:04,394 INFO [RS:0;jenkins-hbase4:41381] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:04:04,394 INFO [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 04:04:04,394 INFO [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 04:04:04,394 DEBUG [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 04:04:04,394 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:04:04,396 DEBUG [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 04:04:04,396 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:04:04,395 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:04:04,395 INFO [RS:1;jenkins-hbase4:39517] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:04:04,398 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:04:04,398 INFO [RS:1;jenkins-hbase4:39517] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:04:04,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:04:04,398 INFO [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(3304): Received CLOSE for 181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:04:04,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:04:04,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:04:04,398 INFO [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:04,398 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-13 04:04:04,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 181cf175e9c79a25d96d58c67e6d24ce, disabling compactions & flushes 2023-02-13 04:04:04,398 DEBUG [RS:1;jenkins-hbase4:39517] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x536d34a2 to 127.0.0.1:63217 2023-02-13 04:04:04,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:04:04,400 DEBUG [RS:1;jenkins-hbase4:39517] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:04,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:04:04,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. after waiting 0 ms 2023-02-13 04:04:04,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:04:04,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 181cf175e9c79a25d96d58c67e6d24ce 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 04:04:04,400 INFO [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 04:04:04,400 DEBUG [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1479): Online Regions={181cf175e9c79a25d96d58c67e6d24ce=hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce.} 2023-02-13 04:04:04,400 DEBUG [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1505): Waiting on 181cf175e9c79a25d96d58c67e6d24ce 2023-02-13 04:04:04,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce/.tmp/info/8a7162c3ae3d4adca1c9886783277644 2023-02-13 04:04:04,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce/.tmp/info/8a7162c3ae3d4adca1c9886783277644 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce/info/8a7162c3ae3d4adca1c9886783277644 2023-02-13 04:04:04,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/.tmp/info/037c71fe3583452e9e7b1301b2a19b56 2023-02-13 04:04:04,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce/info/8a7162c3ae3d4adca1c9886783277644, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 04:04:04,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 037c71fe3583452e9e7b1301b2a19b56 2023-02-13 04:04:04,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 181cf175e9c79a25d96d58c67e6d24ce in 29ms, sequenceid=6, compaction requested=false 2023-02-13 04:04:04,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/namespace/181cf175e9c79a25d96d58c67e6d24ce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 04:04:04,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:04:04,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 181cf175e9c79a25d96d58c67e6d24ce: Waiting for close lock at 1676261044398Running coprocessor pre-close hooks at 1676261044398Disabling compacts and flushes for region at 1676261044398Disabling writes for close at 1676261044400 (+2 ms)Obtaining lock to block concurrent updates at 1676261044400Preparing flush snapshotting stores in 181cf175e9c79a25d96d58c67e6d24ce at 1676261044400Finished memstore snapshotting hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676261044400Flushing stores of hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. at 1676261044401 (+1 ms)Flushing 181cf175e9c79a25d96d58c67e6d24ce/info: creating writer at 1676261044401Flushing 181cf175e9c79a25d96d58c67e6d24ce/info: appending metadata at 1676261044403 (+2 ms)Flushing 181cf175e9c79a25d96d58c67e6d24ce/info: closing flushed file at 1676261044403Flushing 181cf175e9c79a25d96d58c67e6d24ce/info: reopening flushed file at 1676261044422 (+19 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 181cf175e9c79a25d96d58c67e6d24ce in 29ms, sequenceid=6, compaction requested=false at 1676261044429 (+7 ms)Writing region close event to WAL at 1676261044430 (+1 ms)Running coprocessor post-close hooks at 1676261044438 (+8 ms)Closed at 1676261044439 (+1 ms) 2023-02-13 04:04:04,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676261038264.181cf175e9c79a25d96d58c67e6d24ce. 2023-02-13 04:04:04,440 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/.tmp/rep_barrier/cc3d6a966e1642d18985688455847261 2023-02-13 04:04:04,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc3d6a966e1642d18985688455847261 2023-02-13 04:04:04,451 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:04,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/.tmp/table/c54c823db4364996b445992ef8a3999a 2023-02-13 04:04:04,459 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c54c823db4364996b445992ef8a3999a 2023-02-13 04:04:04,459 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/.tmp/info/037c71fe3583452e9e7b1301b2a19b56 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/info/037c71fe3583452e9e7b1301b2a19b56 2023-02-13 04:04:04,463 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 037c71fe3583452e9e7b1301b2a19b56 2023-02-13 04:04:04,463 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/info/037c71fe3583452e9e7b1301b2a19b56, entries=30, sequenceid=57, filesize=8.3 K 2023-02-13 04:04:04,464 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/.tmp/rep_barrier/cc3d6a966e1642d18985688455847261 as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/rep_barrier/cc3d6a966e1642d18985688455847261 2023-02-13 04:04:04,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc3d6a966e1642d18985688455847261 2023-02-13 04:04:04,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/rep_barrier/cc3d6a966e1642d18985688455847261, entries=10, sequenceid=57, filesize=6.1 K 2023-02-13 04:04:04,468 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/.tmp/table/c54c823db4364996b445992ef8a3999a as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/table/c54c823db4364996b445992ef8a3999a 2023-02-13 04:04:04,472 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:04,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c54c823db4364996b445992ef8a3999a 2023-02-13 04:04:04,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/table/c54c823db4364996b445992ef8a3999a, entries=13, sequenceid=57, filesize=6.1 K 2023-02-13 04:04:04,474 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=57, compaction requested=false 2023-02-13 04:04:04,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-13 04:04:04,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 04:04:04,479 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:04,479 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261044394Running coprocessor pre-close hooks at 1676261044394Disabling compacts and flushes for region at 1676261044394Disabling writes for close at 1676261044398 (+4 ms)Obtaining lock to block concurrent updates at 1676261044400 (+2 ms)Preparing flush snapshotting stores in 1588230740 at 1676261044400Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676261044400Flushing stores of hbase:meta,,1.1588230740 at 1676261044401 (+1 ms)Flushing 1588230740/info: creating writer at 1676261044401Flushing 1588230740/info: appending metadata at 1676261044404 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676261044404Flushing 1588230740/rep_barrier: creating writer at 1676261044427 (+23 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676261044429 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676261044429Flushing 1588230740/table: creating writer at 1676261044444 (+15 ms)Flushing 1588230740/table: appending metadata at 1676261044446 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676261044446Flushing 1588230740/info: reopening flushed file at 1676261044460 (+14 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676261044465 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676261044469 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=57, compaction requested=false at 1676261044474 (+5 ms)Writing region close event to WAL at 1676261044475 (+1 ms)Running coprocessor post-close hooks at 1676261044478 (+3 ms)Closed at 1676261044479 (+1 ms) 2023-02-13 04:04:04,480 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:04,597 INFO [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41381,1676261037649; all regions closed. 2023-02-13 04:04:04,601 INFO [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39517,1676261037674; all regions closed. 2023-02-13 04:04:04,601 DEBUG [RS:0;jenkins-hbase4:41381] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/oldWALs 2023-02-13 04:04:04,602 INFO [RS:0;jenkins-hbase4:41381] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41381%2C1676261037649.meta:.meta(num 1676261038209) 2023-02-13 04:04:04,607 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/WALs/jenkins-hbase4.apache.org,41381,1676261037649/jenkins-hbase4.apache.org%2C41381%2C1676261037649.1676261038979 not finished, retry = 0 2023-02-13 04:04:04,607 DEBUG [RS:1;jenkins-hbase4:39517] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/oldWALs 2023-02-13 04:04:04,607 INFO [RS:1;jenkins-hbase4:39517] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39517%2C1676261037674:(num 1676261038631) 2023-02-13 04:04:04,607 DEBUG [RS:1;jenkins-hbase4:39517] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:04,607 INFO [RS:1;jenkins-hbase4:39517] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:04,608 INFO [RS:1;jenkins-hbase4:39517] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 04:04:04,608 INFO [RS:1;jenkins-hbase4:39517] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:04:04,608 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:04,608 INFO [RS:1;jenkins-hbase4:39517] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:04:04,608 INFO [RS:1;jenkins-hbase4:39517] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:04:04,609 INFO [RS:1;jenkins-hbase4:39517] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39517 2023-02-13 04:04:04,610 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:04,610 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39517,1676261037674 2023-02-13 04:04:04,610 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:04,611 ERROR [Listener at localhost/36569-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@218805fc rejected from java.util.concurrent.ThreadPoolExecutor@25b79515[Shutting down, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:04,611 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:04,611 ERROR [Listener at localhost/36569-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30597962 rejected from java.util.concurrent.ThreadPoolExecutor@25b79515[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:04,611 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:04,613 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39517,1676261037674] 2023-02-13 04:04:04,613 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39517,1676261037674; numProcessing=1 2023-02-13 04:04:04,614 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39517,1676261037674 already deleted, retry=false 2023-02-13 04:04:04,614 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39517,1676261037674 expired; onlineServers=1 2023-02-13 04:04:04,709 DEBUG [RS:0;jenkins-hbase4:41381] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/oldWALs 2023-02-13 04:04:04,709 INFO [RS:0;jenkins-hbase4:41381] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41381%2C1676261037649:(num 1676261038979) 2023-02-13 04:04:04,709 DEBUG [RS:0;jenkins-hbase4:41381] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:04,709 INFO [RS:0;jenkins-hbase4:41381] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:04,709 INFO [RS:0;jenkins-hbase4:41381] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 04:04:04,709 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:04,710 INFO [RS:0;jenkins-hbase4:41381] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41381 2023-02-13 04:04:04,712 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41381,1676261037649 2023-02-13 04:04:04,712 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:04,712 ERROR [Listener at localhost/36569-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@465a0a1b rejected from java.util.concurrent.ThreadPoolExecutor@42659608[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:04,712 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41381,1676261037649] 2023-02-13 04:04:04,713 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41381,1676261037649; numProcessing=2 2023-02-13 04:04:04,715 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41381,1676261037649 already deleted, retry=false 2023-02-13 04:04:04,715 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41381,1676261037649 expired; onlineServers=0 2023-02-13 04:04:04,715 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42999,1676261037602' ***** 2023-02-13 04:04:04,715 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 04:04:04,716 DEBUG [M:0;jenkins-hbase4:42999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e6c1f13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:04:04,716 INFO [M:0;jenkins-hbase4:42999] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42999,1676261037602 2023-02-13 04:04:04,716 INFO [M:0;jenkins-hbase4:42999] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42999,1676261037602; all regions closed. 2023-02-13 04:04:04,716 DEBUG [M:0;jenkins-hbase4:42999] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:04,716 DEBUG [M:0;jenkins-hbase4:42999] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 04:04:04,716 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 04:04:04,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261037848] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261037848,5,FailOnTimeoutGroup] 2023-02-13 04:04:04,716 DEBUG [M:0;jenkins-hbase4:42999] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 04:04:04,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261037848] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261037848,5,FailOnTimeoutGroup] 2023-02-13 04:04:04,717 INFO [M:0;jenkins-hbase4:42999] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 04:04:04,717 INFO [M:0;jenkins-hbase4:42999] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 04:04:04,717 INFO [M:0;jenkins-hbase4:42999] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 04:04:04,717 DEBUG [M:0;jenkins-hbase4:42999] master.HMaster(1502): Stopping service threads 2023-02-13 04:04:04,717 INFO [M:0;jenkins-hbase4:42999] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 04:04:04,718 ERROR [M:0;jenkins-hbase4:42999] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 04:04:04,718 INFO [M:0;jenkins-hbase4:42999] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 04:04:04,718 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 04:04:04,718 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:04,718 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:04,718 DEBUG [M:0;jenkins-hbase4:42999] zookeeper.ZKUtil(398): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 04:04:04,719 WARN [M:0;jenkins-hbase4:42999] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 04:04:04,719 INFO [M:0;jenkins-hbase4:42999] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 04:04:04,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:04,719 INFO [M:0;jenkins-hbase4:42999] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 04:04:04,719 DEBUG [M:0;jenkins-hbase4:42999] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:04:04,719 INFO [M:0;jenkins-hbase4:42999] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:04,719 DEBUG [M:0;jenkins-hbase4:42999] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:04,719 DEBUG [M:0;jenkins-hbase4:42999] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:04:04,719 DEBUG [M:0;jenkins-hbase4:42999] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:04,719 INFO [M:0;jenkins-hbase4:42999] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.11 KB heapSize=200.02 KB 2023-02-13 04:04:04,728 INFO [M:0;jenkins-hbase4:42999] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.11 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5dcb230629da493ba4370c91325af98f 2023-02-13 04:04:04,731 DEBUG [M:0;jenkins-hbase4:42999] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5dcb230629da493ba4370c91325af98f as hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5dcb230629da493ba4370c91325af98f 2023-02-13 04:04:04,735 INFO [M:0;jenkins-hbase4:42999] regionserver.HStore(1080): Added hdfs://localhost:46273/user/jenkins/test-data/eaa59b2c-ca46-2e59-c7ed-d682d86c8820/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5dcb230629da493ba4370c91325af98f, entries=53, sequenceid=357, filesize=10.7 K 2023-02-13 04:04:04,736 INFO [M:0;jenkins-hbase4:42999] regionserver.HRegion(2947): Finished flush of dataSize ~167.11 KB/171122, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false 2023-02-13 04:04:04,736 INFO [M:0;jenkins-hbase4:42999] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:04,736 DEBUG [M:0;jenkins-hbase4:42999] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261044719Disabling compacts and flushes for region at 1676261044719Disabling writes for close at 1676261044719Obtaining lock to block concurrent updates at 1676261044719Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676261044719Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171122, getHeapSize=204800, getOffHeapSize=0, getCellsCount=442 at 1676261044720 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676261044720Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676261044721 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676261044723 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676261044723Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676261044732 (+9 ms)Finished flush of dataSize ~167.11 KB/171122, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false at 1676261044736 (+4 ms)Writing region close event to WAL at 1676261044736Closed at 1676261044736 2023-02-13 04:04:04,739 INFO [M:0;jenkins-hbase4:42999] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 04:04:04,739 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:04,740 INFO [M:0;jenkins-hbase4:42999] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42999 2023-02-13 04:04:04,742 DEBUG [M:0;jenkins-hbase4:42999] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42999,1676261037602 already deleted, retry=false 2023-02-13 04:04:04,893 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:04,893 INFO [M:0;jenkins-hbase4:42999] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42999,1676261037602; zookeeper connection closed. 2023-02-13 04:04:04,893 ERROR [Listener at localhost/36569-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c4364aa rejected from java.util.concurrent.ThreadPoolExecutor@787ceffa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:04,894 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): master:42999-0x1004bd97fd50000, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:04,894 ERROR [Listener at localhost/36569-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b081d60 rejected from java.util.concurrent.ThreadPoolExecutor@787ceffa[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:04,993 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:04,993 INFO [RS:0;jenkins-hbase4:41381] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41381,1676261037649; zookeeper connection closed. 2023-02-13 04:04:04,993 ERROR [Listener at localhost/36569-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@20b65b89 rejected from java.util.concurrent.ThreadPoolExecutor@42659608[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:04,993 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7b3fe262] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7b3fe262 2023-02-13 04:04:04,993 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:41381-0x1004bd97fd50001, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:04,993 ERROR [Listener at localhost/36569-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5891825d rejected from java.util.concurrent.ThreadPoolExecutor@42659608[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:05,093 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:05,093 INFO [RS:1;jenkins-hbase4:39517] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39517,1676261037674; zookeeper connection closed. 2023-02-13 04:04:05,094 ERROR [Listener at localhost/36569-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4819057b rejected from java.util.concurrent.ThreadPoolExecutor@25b79515[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:05,094 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5ec401a2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5ec401a2 2023-02-13 04:04:05,094 DEBUG [Listener at localhost/36569-EventThread] zookeeper.ZKWatcher(600): regionserver:39517-0x1004bd97fd50002, quorum=127.0.0.1:63217, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:05,094 ERROR [Listener at localhost/36569-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b730b90 rejected from java.util.concurrent.ThreadPoolExecutor@25b79515[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:05,094 INFO [Listener at localhost/36569] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 04:04:05,095 WARN [Listener at localhost/36569] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:04:05,098 INFO [Listener at localhost/36569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:05,206 WARN [BP-229767130-172.31.14.131-1676261036983 heartbeating to localhost/127.0.0.1:46273] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:04:05,206 WARN [BP-229767130-172.31.14.131-1676261036983 heartbeating to localhost/127.0.0.1:46273] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-229767130-172.31.14.131-1676261036983 (Datanode Uuid bef7f218-87b0-4f63-b23a-d3eb4508d388) service to localhost/127.0.0.1:46273 2023-02-13 04:04:05,206 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/cluster_cea7a04b-7fef-5ea0-8547-5bd45884438e/dfs/data/data3/current/BP-229767130-172.31.14.131-1676261036983] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:05,207 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/cluster_cea7a04b-7fef-5ea0-8547-5bd45884438e/dfs/data/data4/current/BP-229767130-172.31.14.131-1676261036983] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:05,208 WARN [Listener at localhost/36569] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:04:05,211 INFO [Listener at localhost/36569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:05,318 WARN [BP-229767130-172.31.14.131-1676261036983 heartbeating to localhost/127.0.0.1:46273] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:04:05,318 WARN [BP-229767130-172.31.14.131-1676261036983 heartbeating to localhost/127.0.0.1:46273] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-229767130-172.31.14.131-1676261036983 (Datanode Uuid dfaa24bf-1823-470e-b35d-f6f614076ee4) service to localhost/127.0.0.1:46273 2023-02-13 04:04:05,319 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/cluster_cea7a04b-7fef-5ea0-8547-5bd45884438e/dfs/data/data1/current/BP-229767130-172.31.14.131-1676261036983] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:05,319 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/cluster_cea7a04b-7fef-5ea0-8547-5bd45884438e/dfs/data/data2/current/BP-229767130-172.31.14.131-1676261036983] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:05,329 INFO [Listener at localhost/36569] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:05,448 INFO [Listener at localhost/36569] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 04:04:05,490 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 04:04:05,504 INFO [Listener at localhost/36569] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 179) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36569.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/36569.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36569.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/36569.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46273 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/36569 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42999,1676261037602)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36569.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/36569.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46273 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36569.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46273 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:46273 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:46273 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36569.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/36569.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:46273 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:46273 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/36569.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=636 (was 565) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=268 (was 273), ProcessCount=168 (was 168), AvailableMemoryMB=3879 (was 3936) 2023-02-13 04:04:05,514 INFO [Listener at localhost/36569] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=268, ProcessCount=168, AvailableMemoryMB=3879 2023-02-13 04:04:05,525 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/hadoop.log.dir so I do NOT create it in target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4 2023-02-13 04:04:05,525 WARN [Listener at localhost/36569] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 04:04:05,525 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/hadoop.tmp.dir so I do NOT create it in target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4 2023-02-13 04:04:05,525 WARN [Listener at localhost/36569] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/573bdf90-a32d-c1fb-bb90-9e18075d1a76/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 04:04:05,525 DEBUG [Listener at localhost/36569] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4 2023-02-13 04:04:05,525 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 04:04:05,525 INFO [Listener at localhost/36569] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/cluster_835efd3d-6a72-85ba-2da8-9311b86812dd, deleteOnExit=true 2023-02-13 04:04:05,525 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 04:04:05,525 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/test.cache.data in system properties and HBase conf 2023-02-13 04:04:05,525 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 04:04:05,526 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/hadoop.log.dir in system properties and HBase conf 2023-02-13 04:04:05,526 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 04:04:05,526 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 04:04:05,526 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 04:04:05,526 DEBUG [Listener at localhost/36569] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 04:04:05,526 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:04:05,526 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:04:05,526 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 04:04:05,526 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:04:05,526 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 04:04:05,527 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 04:04:05,527 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:04:05,527 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:04:05,527 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 04:04:05,527 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/nfs.dump.dir in system properties and HBase conf 2023-02-13 04:04:05,527 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/java.io.tmpdir in system properties and HBase conf 2023-02-13 04:04:05,527 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:04:05,527 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 04:04:05,527 INFO [Listener at localhost/36569] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 04:04:05,553 WARN [Listener at localhost/36569] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:04:05,553 WARN [Listener at localhost/36569] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:04:05,596 WARN [Listener at localhost/36569] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:04:05,598 INFO [Listener at localhost/36569] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:04:05,603 INFO [Listener at localhost/36569] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/java.io.tmpdir/Jetty_localhost_38545_hdfs____.vh1pwl/webapp 2023-02-13 04:04:05,697 INFO [Listener at localhost/36569] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38545 2023-02-13 04:04:05,701 WARN [Listener at localhost/36569] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:04:05,701 WARN [Listener at localhost/36569] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:04:05,751 WARN [Listener at localhost/36705] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:04:05,767 WARN [Listener at localhost/36705] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:04:05,770 WARN [Listener at localhost/36705] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:04:05,771 INFO [Listener at localhost/36705] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:04:05,776 INFO [Listener at localhost/36705] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/java.io.tmpdir/Jetty_localhost_32829_datanode____.t4jbyx/webapp 2023-02-13 04:04:05,867 INFO [Listener at localhost/36705] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32829 2023-02-13 04:04:05,876 WARN [Listener at localhost/33149] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:04:05,898 WARN [Listener at localhost/33149] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:04:05,899 WARN [Listener at localhost/33149] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:04:05,900 INFO [Listener at localhost/33149] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:04:05,904 INFO [Listener at localhost/33149] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/java.io.tmpdir/Jetty_localhost_38935_datanode____r84dkt/webapp 2023-02-13 04:04:05,981 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa04159cc18e16977: Processing first storage report for DS-59840197-9894-4afe-8062-b8e07f11ef8e from datanode 7defdfea-345e-4541-9409-6110c0c88661 2023-02-13 04:04:05,981 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa04159cc18e16977: from storage DS-59840197-9894-4afe-8062-b8e07f11ef8e node DatanodeRegistration(127.0.0.1:41167, datanodeUuid=7defdfea-345e-4541-9409-6110c0c88661, infoPort=35823, infoSecurePort=0, ipcPort=33149, storageInfo=lv=-57;cid=testClusterID;nsid=1288222089;c=1676261045555), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:04:05,981 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa04159cc18e16977: Processing first storage report for DS-c90d53cf-aea0-4bc2-b71c-de267843a4ea from datanode 7defdfea-345e-4541-9409-6110c0c88661 2023-02-13 04:04:05,981 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa04159cc18e16977: from storage DS-c90d53cf-aea0-4bc2-b71c-de267843a4ea node DatanodeRegistration(127.0.0.1:41167, datanodeUuid=7defdfea-345e-4541-9409-6110c0c88661, infoPort=35823, infoSecurePort=0, ipcPort=33149, storageInfo=lv=-57;cid=testClusterID;nsid=1288222089;c=1676261045555), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:04:06,014 INFO [Listener at localhost/33149] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38935 2023-02-13 04:04:06,023 WARN [Listener at localhost/46387] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:04:06,119 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6306d2822c6fca64: Processing first storage report for DS-1c9cbb83-981b-4517-b88d-d1c2352d77e6 from datanode a05266a0-4978-468b-8e48-898e04c250c3 2023-02-13 04:04:06,119 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6306d2822c6fca64: from storage DS-1c9cbb83-981b-4517-b88d-d1c2352d77e6 node DatanodeRegistration(127.0.0.1:34775, datanodeUuid=a05266a0-4978-468b-8e48-898e04c250c3, infoPort=37599, infoSecurePort=0, ipcPort=46387, storageInfo=lv=-57;cid=testClusterID;nsid=1288222089;c=1676261045555), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:04:06,119 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6306d2822c6fca64: Processing first storage report for DS-df8183ff-e080-479a-883c-57d0241210b4 from datanode a05266a0-4978-468b-8e48-898e04c250c3 2023-02-13 04:04:06,119 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6306d2822c6fca64: from storage DS-df8183ff-e080-479a-883c-57d0241210b4 node DatanodeRegistration(127.0.0.1:34775, datanodeUuid=a05266a0-4978-468b-8e48-898e04c250c3, infoPort=37599, infoSecurePort=0, ipcPort=46387, storageInfo=lv=-57;cid=testClusterID;nsid=1288222089;c=1676261045555), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:04:06,132 DEBUG [Listener at localhost/46387] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4 2023-02-13 04:04:06,133 INFO [Listener at localhost/46387] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/cluster_835efd3d-6a72-85ba-2da8-9311b86812dd/zookeeper_0, clientPort=63278, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/cluster_835efd3d-6a72-85ba-2da8-9311b86812dd/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/cluster_835efd3d-6a72-85ba-2da8-9311b86812dd/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 04:04:06,134 INFO [Listener at localhost/46387] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63278 2023-02-13 04:04:06,134 INFO [Listener at localhost/46387] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,135 INFO [Listener at localhost/46387] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,147 INFO [Listener at localhost/46387] util.FSUtils(479): Created version file at hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1 with version=8 2023-02-13 04:04:06,147 INFO [Listener at localhost/46387] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,148 INFO [Listener at localhost/46387] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,149 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36705/user/jenkins/test-data/513f429e-5b11-aa58-3b12-7b12a4409b9d/hbase-staging 2023-02-13 04:04:06,150 INFO [Listener at localhost/46387] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:04:06,151 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:06,151 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:06,151 INFO [Listener at localhost/46387] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:04:06,151 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:06,151 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:04:06,151 INFO [Listener at localhost/46387] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:04:06,152 INFO [Listener at localhost/46387] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38493 2023-02-13 04:04:06,152 INFO [Listener at localhost/46387] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,153 INFO [Listener at localhost/46387] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,154 INFO [Listener at localhost/46387] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38493 connecting to ZooKeeper ensemble=127.0.0.1:63278 2023-02-13 04:04:06,164 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:384930x0, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:04:06,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38493-0x1004bd9a13a0000 connected 2023-02-13 04:04:06,180 DEBUG [Listener at localhost/46387] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:06,180 DEBUG [Listener at localhost/46387] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:06,180 DEBUG [Listener at localhost/46387] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:04:06,184 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38493 2023-02-13 04:04:06,184 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38493 2023-02-13 04:04:06,184 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38493 2023-02-13 04:04:06,188 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38493 2023-02-13 04:04:06,188 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38493 2023-02-13 04:04:06,188 INFO [Listener at localhost/46387] master.HMaster(439): hbase.rootdir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1, hbase.cluster.distributed=false 2023-02-13 04:04:06,200 INFO [Listener at localhost/46387] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:04:06,200 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:06,200 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:06,200 INFO [Listener at localhost/46387] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:04:06,200 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:06,200 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:04:06,200 INFO [Listener at localhost/46387] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:04:06,201 INFO [Listener at localhost/46387] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34745 2023-02-13 04:04:06,201 INFO [Listener at localhost/46387] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:04:06,204 DEBUG [Listener at localhost/46387] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:06,204 INFO [Listener at localhost/46387] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,205 INFO [Listener at localhost/46387] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,206 INFO [Listener at localhost/46387] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34745 connecting to ZooKeeper ensemble=127.0.0.1:63278 2023-02-13 04:04:06,209 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:347450x0, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:04:06,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34745-0x1004bd9a13a0001 connected 2023-02-13 04:04:06,210 DEBUG [Listener at localhost/46387] zookeeper.ZKUtil(164): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:06,211 DEBUG [Listener at localhost/46387] zookeeper.ZKUtil(164): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:06,211 DEBUG [Listener at localhost/46387] zookeeper.ZKUtil(164): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:04:06,212 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34745 2023-02-13 04:04:06,212 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34745 2023-02-13 04:04:06,213 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34745 2023-02-13 04:04:06,213 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34745 2023-02-13 04:04:06,216 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34745 2023-02-13 04:04:06,226 INFO [Listener at localhost/46387] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:04:06,226 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:06,226 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:06,226 INFO [Listener at localhost/46387] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:04:06,227 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:06,227 INFO [Listener at localhost/46387] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:04:06,227 INFO [Listener at localhost/46387] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:04:06,227 INFO [Listener at localhost/46387] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38753 2023-02-13 04:04:06,228 INFO [Listener at localhost/46387] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:04:06,230 DEBUG [Listener at localhost/46387] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:06,230 INFO [Listener at localhost/46387] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,231 INFO [Listener at localhost/46387] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,232 INFO [Listener at localhost/46387] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38753 connecting to ZooKeeper ensemble=127.0.0.1:63278 2023-02-13 04:04:06,239 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:387530x0, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:04:06,241 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38753-0x1004bd9a13a0002 connected 2023-02-13 04:04:06,241 DEBUG [Listener at localhost/46387] zookeeper.ZKUtil(164): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:06,241 DEBUG [Listener at localhost/46387] zookeeper.ZKUtil(164): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:06,241 DEBUG [Listener at localhost/46387] zookeeper.ZKUtil(164): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:04:06,242 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38753 2023-02-13 04:04:06,242 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38753 2023-02-13 04:04:06,242 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38753 2023-02-13 04:04:06,248 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38753 2023-02-13 04:04:06,248 DEBUG [Listener at localhost/46387] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38753 2023-02-13 04:04:06,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38493,1676261046150 2023-02-13 04:04:06,251 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:04:06,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38493,1676261046150 2023-02-13 04:04:06,253 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:06,253 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:06,253 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:06,253 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:06,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:04:06,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38493,1676261046150 from backup master directory 2023-02-13 04:04:06,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:04:06,258 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38493,1676261046150 2023-02-13 04:04:06,258 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:04:06,258 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:04:06,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,38493,1676261046150 2023-02-13 04:04:06,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/hbase.id with ID: b22ecf3e-0252-4e74-9e43-a7dabf4777ea 2023-02-13 04:04:06,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:06,285 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:06,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x22923e90 to 127.0.0.1:63278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:06,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5766e53a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:06,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:06,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 04:04:06,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:06,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/data/master/store-tmp 2023-02-13 04:04:06,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:06,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:04:06,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:06,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:06,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:04:06,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:06,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:06,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261046315Disabling compacts and flushes for region at 1676261046315Disabling writes for close at 1676261046315Writing region close event to WAL at 1676261046315Closed at 1676261046315 2023-02-13 04:04:06,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/WALs/jenkins-hbase4.apache.org,38493,1676261046150 2023-02-13 04:04:06,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38493%2C1676261046150, suffix=, logDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/WALs/jenkins-hbase4.apache.org,38493,1676261046150, archiveDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/oldWALs, maxLogs=10 2023-02-13 04:04:06,330 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34775,DS-1c9cbb83-981b-4517-b88d-d1c2352d77e6,DISK] 2023-02-13 04:04:06,330 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-59840197-9894-4afe-8062-b8e07f11ef8e,DISK] 2023-02-13 04:04:06,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/WALs/jenkins-hbase4.apache.org,38493,1676261046150/jenkins-hbase4.apache.org%2C38493%2C1676261046150.1676261046318 2023-02-13 04:04:06,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34775,DS-1c9cbb83-981b-4517-b88d-d1c2352d77e6,DISK], DatanodeInfoWithStorage[127.0.0.1:41167,DS-59840197-9894-4afe-8062-b8e07f11ef8e,DISK]] 2023-02-13 04:04:06,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:06,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:06,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:06,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:06,333 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:06,334 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 04:04:06,334 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 04:04:06,335 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:06,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:06,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:06,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:06,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:06,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61951563, jitterRate=-0.07684977352619171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:04:06,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676261046332Initializing all the Stores at 1676261046333 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261046333Cleaning up temporary data from old regions at 1676261046336 (+3 ms)Cleaning up detritus from prior splits at 1676261046336Region opened successfully at 1676261046339 (+3 ms) 2023-02-13 04:04:06,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 04:04:06,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 04:04:06,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 04:04:06,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 04:04:06,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 04:04:06,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 04:04:06,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 04:04:06,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 04:04:06,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 04:04:06,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 04:04:06,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 04:04:06,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 04:04:06,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 04:04:06,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 04:04:06,357 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:06,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 04:04:06,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 04:04:06,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 04:04:06,360 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:06,360 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:06,360 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:06,360 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:06,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,38493,1676261046150, sessionid=0x1004bd9a13a0000, setting cluster-up flag (Was=false) 2023-02-13 04:04:06,365 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:06,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 04:04:06,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38493,1676261046150 2023-02-13 04:04:06,373 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:06,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 04:04:06,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38493,1676261046150 2023-02-13 04:04:06,384 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.hbase-snapshot/.tmp 2023-02-13 04:04:06,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 04:04:06,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:06,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:06,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:06,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:06,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 04:04:06,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:04:06,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676261076388 2023-02-13 04:04:06,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 04:04:06,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 04:04:06,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 04:04:06,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 04:04:06,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 04:04:06,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 04:04:06,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,390 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:04:06,390 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 04:04:06,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 04:04:06,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 04:04:06,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 04:04:06,391 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:06,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 04:04:06,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 04:04:06,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261046392,5,FailOnTimeoutGroup] 2023-02-13 04:04:06,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261046392,5,FailOnTimeoutGroup] 2023-02-13 04:04:06,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 04:04:06,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,398 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:06,399 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:06,399 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1 2023-02-13 04:04:06,404 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:06,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:04:06,406 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/info 2023-02-13 04:04:06,406 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:04:06,406 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:06,406 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:04:06,407 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:04:06,407 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:04:06,408 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:06,408 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:04:06,408 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/table 2023-02-13 04:04:06,409 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:04:06,409 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:06,410 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740 2023-02-13 04:04:06,410 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740 2023-02-13 04:04:06,411 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:04:06,412 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:04:06,413 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:06,413 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59434449, jitterRate=-0.11435769498348236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:04:06,414 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676261046404Initializing all the Stores at 1676261046404Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261046405 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261046405Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261046405Cleaning up temporary data from old regions at 1676261046410 (+5 ms)Cleaning up detritus from prior splits at 1676261046411 (+1 ms)Region opened successfully at 1676261046414 (+3 ms) 2023-02-13 04:04:06,414 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:04:06,414 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:04:06,414 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:04:06,414 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:04:06,414 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:04:06,414 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:06,414 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261046414Disabling compacts and flushes for region at 1676261046414Disabling writes for close at 1676261046414Writing region close event to WAL at 1676261046414Closed at 1676261046414 2023-02-13 04:04:06,415 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:04:06,415 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 04:04:06,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 04:04:06,416 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 04:04:06,417 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 04:04:06,450 INFO [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(952): ClusterId : b22ecf3e-0252-4e74-9e43-a7dabf4777ea 2023-02-13 04:04:06,450 DEBUG [RS:0;jenkins-hbase4:34745] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:04:06,450 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(952): ClusterId : b22ecf3e-0252-4e74-9e43-a7dabf4777ea 2023-02-13 04:04:06,450 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:04:06,452 DEBUG [RS:0;jenkins-hbase4:34745] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:04:06,452 DEBUG [RS:0;jenkins-hbase4:34745] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:04:06,452 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:04:06,452 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:04:06,455 DEBUG [RS:0;jenkins-hbase4:34745] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:04:06,457 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:04:06,458 DEBUG [RS:0;jenkins-hbase4:34745] zookeeper.ReadOnlyZKClient(139): Connect 0x4d470a5e to 127.0.0.1:63278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:06,458 DEBUG [RS:1;jenkins-hbase4:38753] zookeeper.ReadOnlyZKClient(139): Connect 0x496bb479 to 127.0.0.1:63278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:06,465 DEBUG [RS:0;jenkins-hbase4:34745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4380ed86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:06,465 DEBUG [RS:1;jenkins-hbase4:38753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47ac4324, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:06,466 DEBUG [RS:0;jenkins-hbase4:34745] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47bf612e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:04:06,466 DEBUG [RS:1;jenkins-hbase4:38753] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4393df09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:04:06,479 DEBUG [RS:0;jenkins-hbase4:34745] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34745 2023-02-13 04:04:06,479 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38753 2023-02-13 04:04:06,479 INFO [RS:0;jenkins-hbase4:34745] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:04:06,479 INFO [RS:0;jenkins-hbase4:34745] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:04:06,479 INFO [RS:1;jenkins-hbase4:38753] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:04:06,479 INFO [RS:1;jenkins-hbase4:38753] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:04:06,479 DEBUG [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:04:06,479 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:04:06,479 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38493,1676261046150 with isa=jenkins-hbase4.apache.org/172.31.14.131:38753, startcode=1676261046226 2023-02-13 04:04:06,480 DEBUG [RS:1;jenkins-hbase4:38753] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:04:06,480 INFO [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,38493,1676261046150 with isa=jenkins-hbase4.apache.org/172.31.14.131:34745, startcode=1676261046199 2023-02-13 04:04:06,480 DEBUG [RS:0;jenkins-hbase4:34745] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:04:06,481 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56871, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:04:06,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:06,485 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34641, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:04:06,486 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1 2023-02-13 04:04:06,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:06,486 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36705 2023-02-13 04:04:06,486 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:04:06,486 DEBUG [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1 2023-02-13 04:04:06,486 DEBUG [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36705 2023-02-13 04:04:06,486 DEBUG [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:04:06,487 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:06,491 DEBUG [RS:1;jenkins-hbase4:38753] zookeeper.ZKUtil(162): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:06,491 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38753,1676261046226] 2023-02-13 04:04:06,491 WARN [RS:1;jenkins-hbase4:38753] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:04:06,491 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34745,1676261046199] 2023-02-13 04:04:06,491 DEBUG [RS:0;jenkins-hbase4:34745] zookeeper.ZKUtil(162): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:06,491 INFO [RS:1;jenkins-hbase4:38753] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:06,491 WARN [RS:0;jenkins-hbase4:34745] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:04:06,491 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/WALs/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:06,491 INFO [RS:0;jenkins-hbase4:34745] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:06,491 DEBUG [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/WALs/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:06,497 DEBUG [RS:0;jenkins-hbase4:34745] zookeeper.ZKUtil(162): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:06,497 DEBUG [RS:1;jenkins-hbase4:38753] zookeeper.ZKUtil(162): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:06,497 DEBUG [RS:0;jenkins-hbase4:34745] zookeeper.ZKUtil(162): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:06,497 DEBUG [RS:1;jenkins-hbase4:38753] zookeeper.ZKUtil(162): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:06,498 DEBUG [RS:0;jenkins-hbase4:34745] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:04:06,498 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:04:06,498 INFO [RS:0;jenkins-hbase4:34745] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:04:06,498 INFO [RS:1;jenkins-hbase4:38753] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:04:06,499 INFO [RS:0;jenkins-hbase4:34745] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:04:06,500 INFO [RS:0;jenkins-hbase4:34745] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:04:06,500 INFO [RS:0;jenkins-hbase4:34745] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,500 INFO [RS:1;jenkins-hbase4:38753] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:04:06,500 INFO [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:04:06,501 INFO [RS:1;jenkins-hbase4:38753] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:04:06,501 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,508 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:04:06,508 INFO [RS:0;jenkins-hbase4:34745] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,508 DEBUG [RS:0;jenkins-hbase4:34745] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,508 DEBUG [RS:0;jenkins-hbase4:34745] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,508 DEBUG [RS:0;jenkins-hbase4:34745] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,508 DEBUG [RS:0;jenkins-hbase4:34745] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,509 DEBUG [RS:0;jenkins-hbase4:34745] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,509 DEBUG [RS:0;jenkins-hbase4:34745] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:04:06,509 DEBUG [RS:0;jenkins-hbase4:34745] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,509 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,509 DEBUG [RS:0;jenkins-hbase4:34745] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,509 DEBUG [RS:0;jenkins-hbase4:34745] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,509 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,509 DEBUG [RS:0;jenkins-hbase4:34745] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,509 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,509 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,509 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,509 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,510 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:04:06,510 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,510 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,510 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,510 DEBUG [RS:1;jenkins-hbase4:38753] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:06,510 INFO [RS:0;jenkins-hbase4:34745] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,510 INFO [RS:0;jenkins-hbase4:34745] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,510 INFO [RS:0;jenkins-hbase4:34745] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,512 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,512 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,512 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,523 INFO [RS:1;jenkins-hbase4:38753] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:04:06,523 INFO [RS:0;jenkins-hbase4:34745] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:04:06,523 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38753,1676261046226-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,524 INFO [RS:0;jenkins-hbase4:34745] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34745,1676261046199-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,533 INFO [RS:1;jenkins-hbase4:38753] regionserver.Replication(203): jenkins-hbase4.apache.org,38753,1676261046226 started 2023-02-13 04:04:06,534 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38753,1676261046226, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38753, sessionid=0x1004bd9a13a0002 2023-02-13 04:04:06,534 INFO [RS:0;jenkins-hbase4:34745] regionserver.Replication(203): jenkins-hbase4.apache.org,34745,1676261046199 started 2023-02-13 04:04:06,534 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:04:06,534 INFO [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34745,1676261046199, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34745, sessionid=0x1004bd9a13a0001 2023-02-13 04:04:06,534 DEBUG [RS:1;jenkins-hbase4:38753] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:06,534 DEBUG [RS:0;jenkins-hbase4:34745] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:04:06,534 DEBUG [RS:0;jenkins-hbase4:34745] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:06,534 DEBUG [RS:0;jenkins-hbase4:34745] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34745,1676261046199' 2023-02-13 04:04:06,534 DEBUG [RS:0;jenkins-hbase4:34745] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:06,534 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38753,1676261046226' 2023-02-13 04:04:06,534 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:06,534 DEBUG [RS:0;jenkins-hbase4:34745] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:06,534 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:06,535 DEBUG [RS:0;jenkins-hbase4:34745] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:04:06,535 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:04:06,535 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:04:06,535 DEBUG [RS:0;jenkins-hbase4:34745] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:04:06,535 DEBUG [RS:1;jenkins-hbase4:38753] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:06,535 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38753,1676261046226' 2023-02-13 04:04:06,535 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:06,535 DEBUG [RS:0;jenkins-hbase4:34745] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:06,535 DEBUG [RS:0;jenkins-hbase4:34745] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34745,1676261046199' 2023-02-13 04:04:06,535 DEBUG [RS:0;jenkins-hbase4:34745] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:06,535 DEBUG [RS:1;jenkins-hbase4:38753] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:06,535 DEBUG [RS:0;jenkins-hbase4:34745] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:06,535 DEBUG [RS:1;jenkins-hbase4:38753] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:04:06,535 INFO [RS:1;jenkins-hbase4:38753] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:04:06,535 INFO [RS:1;jenkins-hbase4:38753] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:04:06,535 DEBUG [RS:0;jenkins-hbase4:34745] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:04:06,535 INFO [RS:0;jenkins-hbase4:34745] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:04:06,535 INFO [RS:0;jenkins-hbase4:34745] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:04:06,567 DEBUG [jenkins-hbase4:38493] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 04:04:06,568 DEBUG [jenkins-hbase4:38493] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:04:06,569 DEBUG [jenkins-hbase4:38493] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:04:06,569 DEBUG [jenkins-hbase4:38493] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:04:06,569 DEBUG [jenkins-hbase4:38493] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:04:06,569 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38753,1676261046226, state=OPENING 2023-02-13 04:04:06,570 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 04:04:06,571 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:06,572 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:04:06,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38753,1676261046226}] 2023-02-13 04:04:06,728 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:06,728 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:04:06,730 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39796, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:04:06,733 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 04:04:06,733 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:06,734 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38753%2C1676261046226.meta, suffix=.meta, logDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/WALs/jenkins-hbase4.apache.org,38753,1676261046226, archiveDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/oldWALs, maxLogs=32 2023-02-13 04:04:06,747 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34775,DS-1c9cbb83-981b-4517-b88d-d1c2352d77e6,DISK] 2023-02-13 04:04:06,747 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-59840197-9894-4afe-8062-b8e07f11ef8e,DISK] 2023-02-13 04:04:06,749 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/WALs/jenkins-hbase4.apache.org,38753,1676261046226/jenkins-hbase4.apache.org%2C38753%2C1676261046226.meta.1676261046734.meta 2023-02-13 04:04:06,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34775,DS-1c9cbb83-981b-4517-b88d-d1c2352d77e6,DISK], DatanodeInfoWithStorage[127.0.0.1:41167,DS-59840197-9894-4afe-8062-b8e07f11ef8e,DISK]] 2023-02-13 04:04:06,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:06,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 04:04:06,749 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 04:04:06,749 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 04:04:06,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 04:04:06,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:06,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 04:04:06,750 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 04:04:06,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:04:06,752 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/info 2023-02-13 04:04:06,752 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/info 2023-02-13 04:04:06,752 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:04:06,753 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:06,753 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:04:06,753 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:04:06,754 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:04:06,754 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:04:06,754 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:06,754 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:04:06,755 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/table 2023-02-13 04:04:06,755 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/table 2023-02-13 04:04:06,755 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:04:06,756 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:06,756 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740 2023-02-13 04:04:06,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740 2023-02-13 04:04:06,759 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:04:06,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:04:06,760 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70239411, jitterRate=0.0466487854719162}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:04:06,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676261046750Writing region info on filesystem at 1676261046750Initializing all the Stores at 1676261046751 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261046751Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261046751Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261046751Cleaning up temporary data from old regions at 1676261046758 (+7 ms)Cleaning up detritus from prior splits at 1676261046758Running coprocessor post-open hooks at 1676261046760 (+2 ms)Region opened successfully at 1676261046760 2023-02-13 04:04:06,761 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676261046728 2023-02-13 04:04:06,764 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 04:04:06,765 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 04:04:06,765 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38753,1676261046226, state=OPEN 2023-02-13 04:04:06,766 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 04:04:06,766 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:04:06,768 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 04:04:06,768 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38753,1676261046226 in 194 msec 2023-02-13 04:04:06,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 04:04:06,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-13 04:04:06,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 385 msec 2023-02-13 04:04:06,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676261046252, completionTime=-1 2023-02-13 04:04:06,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 04:04:06,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 04:04:06,777 DEBUG [hconnection-0x5e2dc041-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:06,778 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39810, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:06,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 04:04:06,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676261106780 2023-02-13 04:04:06,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676261166780 2023-02-13 04:04:06,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 9 msec 2023-02-13 04:04:06,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38493,1676261046150-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38493,1676261046150-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38493,1676261046150-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38493, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:06,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 04:04:06,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:06,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 04:04:06,789 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 04:04:06,791 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:04:06,791 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:04:06,793 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:06,793 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7 empty. 2023-02-13 04:04:06,793 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:06,793 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 04:04:06,802 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:06,803 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0bbe2f69137dddaa7e219eb7a06d8ea7, NAME => 'hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp 2023-02-13 04:04:06,808 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:06,808 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 0bbe2f69137dddaa7e219eb7a06d8ea7, disabling compactions & flushes 2023-02-13 04:04:06,808 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:06,808 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:06,808 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. after waiting 0 ms 2023-02-13 04:04:06,808 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:06,808 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:06,808 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 0bbe2f69137dddaa7e219eb7a06d8ea7: Waiting for close lock at 1676261046808Disabling compacts and flushes for region at 1676261046808Disabling writes for close at 1676261046808Writing region close event to WAL at 1676261046808Closed at 1676261046808 2023-02-13 04:04:06,810 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:04:06,811 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261046810"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261046810"}]},"ts":"1676261046810"} 2023-02-13 04:04:06,813 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:04:06,813 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:04:06,814 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261046813"}]},"ts":"1676261046813"} 2023-02-13 04:04:06,815 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 04:04:06,818 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:04:06,818 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:04:06,818 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:04:06,818 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:04:06,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0bbe2f69137dddaa7e219eb7a06d8ea7, ASSIGN}] 2023-02-13 04:04:06,821 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0bbe2f69137dddaa7e219eb7a06d8ea7, ASSIGN 2023-02-13 04:04:06,821 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0bbe2f69137dddaa7e219eb7a06d8ea7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34745,1676261046199; forceNewPlan=false, retain=false 2023-02-13 04:04:06,972 INFO [jenkins-hbase4:38493] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:04:06,972 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0bbe2f69137dddaa7e219eb7a06d8ea7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:06,972 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261046972"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261046972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261046972"}]},"ts":"1676261046972"} 2023-02-13 04:04:06,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0bbe2f69137dddaa7e219eb7a06d8ea7, server=jenkins-hbase4.apache.org,34745,1676261046199}] 2023-02-13 04:04:07,126 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:07,126 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:04:07,128 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42184, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:04:07,131 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:07,132 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34745%2C1676261046199, suffix=, logDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/WALs/jenkins-hbase4.apache.org,34745,1676261046199, archiveDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/oldWALs, maxLogs=32 2023-02-13 04:04:07,145 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34775,DS-1c9cbb83-981b-4517-b88d-d1c2352d77e6,DISK] 2023-02-13 04:04:07,145 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-59840197-9894-4afe-8062-b8e07f11ef8e,DISK] 2023-02-13 04:04:07,147 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/WALs/jenkins-hbase4.apache.org,34745,1676261046199/jenkins-hbase4.apache.org%2C34745%2C1676261046199.1676261047132 2023-02-13 04:04:07,148 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34775,DS-1c9cbb83-981b-4517-b88d-d1c2352d77e6,DISK], DatanodeInfoWithStorage[127.0.0.1:41167,DS-59840197-9894-4afe-8062-b8e07f11ef8e,DISK]] 2023-02-13 04:04:07,148 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0bbe2f69137dddaa7e219eb7a06d8ea7, NAME => 'hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:07,148 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:07,148 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:07,148 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:07,148 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:07,150 INFO [StoreOpener-0bbe2f69137dddaa7e219eb7a06d8ea7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:07,151 DEBUG [StoreOpener-0bbe2f69137dddaa7e219eb7a06d8ea7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7/info 2023-02-13 04:04:07,151 DEBUG [StoreOpener-0bbe2f69137dddaa7e219eb7a06d8ea7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7/info 2023-02-13 04:04:07,151 INFO [StoreOpener-0bbe2f69137dddaa7e219eb7a06d8ea7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bbe2f69137dddaa7e219eb7a06d8ea7 columnFamilyName info 2023-02-13 04:04:07,151 INFO [StoreOpener-0bbe2f69137dddaa7e219eb7a06d8ea7-1] regionserver.HStore(310): Store=0bbe2f69137dddaa7e219eb7a06d8ea7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:07,152 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:07,152 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:07,154 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:07,156 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:07,156 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0bbe2f69137dddaa7e219eb7a06d8ea7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62239723, jitterRate=-0.07255585491657257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:04:07,156 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0bbe2f69137dddaa7e219eb7a06d8ea7: Running coprocessor pre-open hook at 1676261047148Writing region info on filesystem at 1676261047148Initializing all the Stores at 1676261047149 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261047149Cleaning up temporary data from old regions at 1676261047153 (+4 ms)Cleaning up detritus from prior splits at 1676261047153Running coprocessor post-open hooks at 1676261047156 (+3 ms)Region opened successfully at 1676261047156 2023-02-13 04:04:07,157 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7., pid=6, masterSystemTime=1676261047126 2023-02-13 04:04:07,160 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:07,160 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:07,160 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0bbe2f69137dddaa7e219eb7a06d8ea7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:07,161 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261047160"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261047160"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261047160"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261047160"}]},"ts":"1676261047160"} 2023-02-13 04:04:07,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 04:04:07,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0bbe2f69137dddaa7e219eb7a06d8ea7, server=jenkins-hbase4.apache.org,34745,1676261046199 in 188 msec 2023-02-13 04:04:07,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 04:04:07,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0bbe2f69137dddaa7e219eb7a06d8ea7, ASSIGN in 344 msec 2023-02-13 04:04:07,165 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:04:07,165 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261047165"}]},"ts":"1676261047165"} 2023-02-13 04:04:07,166 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 04:04:07,168 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:04:07,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 380 msec 2023-02-13 04:04:07,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 04:04:07,190 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:04:07,191 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:07,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:07,194 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42194, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:07,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 04:04:07,203 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:04:07,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-13 04:04:07,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 04:04:07,216 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:04:07,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-13 04:04:07,231 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 04:04:07,233 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 04:04:07,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.975sec 2023-02-13 04:04:07,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 04:04:07,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 04:04:07,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 04:04:07,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38493,1676261046150-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 04:04:07,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38493,1676261046150-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 04:04:07,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 04:04:07,250 DEBUG [Listener at localhost/46387] zookeeper.ReadOnlyZKClient(139): Connect 0x1ce25144 to 127.0.0.1:63278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:07,258 DEBUG [Listener at localhost/46387] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6782b1e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:07,260 DEBUG [hconnection-0x21eb3a36-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:07,261 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39824, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:07,262 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38493,1676261046150 2023-02-13 04:04:07,263 DEBUG [Listener at localhost/46387] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 04:04:07,264 DEBUG [Listener at localhost/46387] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:04:07,268 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46472, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:04:07,269 INFO [Listener at localhost/46387] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-13 04:04:07,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-13 04:04:07,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 04:04:07,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:46472 deadline: 1676261107269, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-13 04:04:07,270 INFO [Listener at localhost/46387] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-13 04:04:07,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:07,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:07,274 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:04:07,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-13 04:04:07,274 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:04:07,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:07,276 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:07,276 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51 empty. 2023-02-13 04:04:07,276 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:07,276 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-13 04:04:07,285 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:07,286 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7d918e7c28eead0044d9bb0dd30d1a51, NAME => 'testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp 2023-02-13 04:04:07,291 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:07,291 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 7d918e7c28eead0044d9bb0dd30d1a51, disabling compactions & flushes 2023-02-13 04:04:07,291 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:07,291 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:07,291 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. after waiting 0 ms 2023-02-13 04:04:07,291 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:07,292 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:07,292 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 7d918e7c28eead0044d9bb0dd30d1a51: Waiting for close lock at 1676261047291Disabling compacts and flushes for region at 1676261047291Disabling writes for close at 1676261047291Writing region close event to WAL at 1676261047291Closed at 1676261047292 (+1 ms) 2023-02-13 04:04:07,293 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:04:07,294 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676261047294"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261047294"}]},"ts":"1676261047294"} 2023-02-13 04:04:07,296 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:04:07,296 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:04:07,296 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261047296"}]},"ts":"1676261047296"} 2023-02-13 04:04:07,297 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-13 04:04:07,301 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:04:07,302 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:04:07,302 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:04:07,302 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:04:07,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=7d918e7c28eead0044d9bb0dd30d1a51, ASSIGN}] 2023-02-13 04:04:07,304 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=7d918e7c28eead0044d9bb0dd30d1a51, ASSIGN 2023-02-13 04:04:07,304 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=7d918e7c28eead0044d9bb0dd30d1a51, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38753,1676261046226; forceNewPlan=false, retain=false 2023-02-13 04:04:07,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:07,454 INFO [jenkins-hbase4:38493] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:04:07,455 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7d918e7c28eead0044d9bb0dd30d1a51, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:07,455 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676261047455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261047455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261047455"}]},"ts":"1676261047455"} 2023-02-13 04:04:07,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 7d918e7c28eead0044d9bb0dd30d1a51, server=jenkins-hbase4.apache.org,38753,1676261046226}] 2023-02-13 04:04:07,537 INFO [RS:1;jenkins-hbase4:38753] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38753%2C1676261046226, suffix=, logDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/WALs/jenkins-hbase4.apache.org,38753,1676261046226, archiveDir=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/oldWALs, maxLogs=32 2023-02-13 04:04:07,549 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41167,DS-59840197-9894-4afe-8062-b8e07f11ef8e,DISK] 2023-02-13 04:04:07,549 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34775,DS-1c9cbb83-981b-4517-b88d-d1c2352d77e6,DISK] 2023-02-13 04:04:07,551 INFO [RS:1;jenkins-hbase4:38753] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/WALs/jenkins-hbase4.apache.org,38753,1676261046226/jenkins-hbase4.apache.org%2C38753%2C1676261046226.1676261047537 2023-02-13 04:04:07,551 DEBUG [RS:1;jenkins-hbase4:38753] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41167,DS-59840197-9894-4afe-8062-b8e07f11ef8e,DISK], DatanodeInfoWithStorage[127.0.0.1:34775,DS-1c9cbb83-981b-4517-b88d-d1c2352d77e6,DISK]] 2023-02-13 04:04:07,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:07,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:07,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7d918e7c28eead0044d9bb0dd30d1a51, NAME => 'testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:07,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:07,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:07,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:07,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:07,612 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:07,613 DEBUG [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1 2023-02-13 04:04:07,614 DEBUG [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1 2023-02-13 04:04:07,614 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d918e7c28eead0044d9bb0dd30d1a51 columnFamilyName f1 2023-02-13 04:04:07,614 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] regionserver.HStore(310): Store=7d918e7c28eead0044d9bb0dd30d1a51/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:07,614 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:07,615 DEBUG [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2 2023-02-13 04:04:07,615 DEBUG [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2 2023-02-13 04:04:07,616 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d918e7c28eead0044d9bb0dd30d1a51 columnFamilyName f2 2023-02-13 04:04:07,616 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] regionserver.HStore(310): Store=7d918e7c28eead0044d9bb0dd30d1a51/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:07,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:07,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:07,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:07,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:07,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:07,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7d918e7c28eead0044d9bb0dd30d1a51; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71452674, jitterRate=0.06472781300544739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:07,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7d918e7c28eead0044d9bb0dd30d1a51: Running coprocessor pre-open hook at 1676261047611Writing region info on filesystem at 1676261047611Initializing all the Stores at 1676261047612 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261047612Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261047612Cleaning up temporary data from old regions at 1676261047617 (+5 ms)Cleaning up detritus from prior splits at 1676261047618 (+1 ms)Running coprocessor post-open hooks at 1676261047621 (+3 ms)Region opened successfully at 1676261047621 2023-02-13 04:04:07,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51., pid=12, masterSystemTime=1676261047608 2023-02-13 04:04:07,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:07,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:07,623 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=7d918e7c28eead0044d9bb0dd30d1a51, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:07,623 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676261047623"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261047623"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261047623"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261047623"}]},"ts":"1676261047623"} 2023-02-13 04:04:07,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 04:04:07,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 7d918e7c28eead0044d9bb0dd30d1a51, server=jenkins-hbase4.apache.org,38753,1676261046226 in 169 msec 2023-02-13 04:04:07,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 04:04:07,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=7d918e7c28eead0044d9bb0dd30d1a51, ASSIGN in 324 msec 2023-02-13 04:04:07,628 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:04:07,628 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261047628"}]},"ts":"1676261047628"} 2023-02-13 04:04:07,629 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-13 04:04:07,631 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:04:07,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 359 msec 2023-02-13 04:04:07,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:07,879 INFO [Listener at localhost/46387] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-13 04:04:07,879 DEBUG [Listener at localhost/46387] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-13 04:04:07,879 INFO [Listener at localhost/46387] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:04:07,881 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-13 04:04:07,881 INFO [Listener at localhost/46387] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:04:07,881 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-13 04:04:07,881 INFO [Listener at localhost/46387] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 04:04:07,909 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38753] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:07,994 INFO [Listener at localhost/46387] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 04:04:07,994 INFO [Listener at localhost/46387] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 04:04:07,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 04:04:07,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676261047995 (current time:1676261047995). 2023-02-13 04:04:07,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 04:04:07,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] zookeeper.ReadOnlyZKClient(139): Connect 0x01f2c797 to 127.0.0.1:63278 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:07,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@205be7d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:07,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:08,000 INFO [RS-EventLoopGroup-17-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39836, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:08,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01f2c797 to 127.0.0.1:63278 2023-02-13 04:04:08,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:08,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 04:04:08,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 04:04:08,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 04:04:08,005 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 04:04:08,005 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676261648005 2023-02-13 04:04:08,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 04:04:08,005 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,007 DEBUG [Listener at localhost/46387] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 04:04:08,007 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 04:04:08,007 DEBUG [Listener at localhost/46387] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 04:04:08,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 04:04:08,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-13 04:04:08,009 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 04:04:08,009 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676261648009 2023-02-13 04:04:08,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,023 INFO [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-13 04:04:08,023 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:04:08,023 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-13 04:04:08,024 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 04:04:08,024 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,024 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,026 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,026 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:08,026 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:08,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:08,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:08,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:08,026 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,026 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:04:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-13 04:04:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-13 04:04:08,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,027 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-13 04:04:08,028 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-13 04:04:08,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,034 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,034 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-13 04:04:08,034 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:04:08,034 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-13 04:04:08,035 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 04:04:08,035 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 04:04:08,035 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:04:08,035 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38753,1676261046226' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 04:04:08,036 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 04:04:08,036 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 04:04:08,036 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34745,1676261046199' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 04:04:08,037 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,037 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:08,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:08,038 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,038 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:08,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:08,038 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:08,038 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,039 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:08,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38753,1676261046226' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-13 04:04:08,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67fdefb7[Count = 0] remaining members to acquire global barrier 2023-02-13 04:04:08,040 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 04:04:08,040 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,041 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,041 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,041 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,041 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:04:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,041 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 04:04:08,041 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 04:04:08,041 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 04:04:08,041 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34745,1676261046199' in zk 2023-02-13 04:04:08,041 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 04:04:08,041 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:04:08,041 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,041 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. started... 2023-02-13 04:04:08,042 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7d918e7c28eead0044d9bb0dd30d1a51 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 04:04:08,044 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 04:04:08,044 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:08,044 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 04:04:08,055 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/.tmp/f1/cf7a0667593042909484a23596a376f8 2023-02-13 04:04:08,071 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/.tmp/f2/019da4435cc243cebd61244db1306dd1 2023-02-13 04:04:08,075 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/.tmp/f1/cf7a0667593042909484a23596a376f8 as hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/cf7a0667593042909484a23596a376f8 2023-02-13 04:04:08,079 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/cf7a0667593042909484a23596a376f8, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 04:04:08,079 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/.tmp/f2/019da4435cc243cebd61244db1306dd1 as hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/019da4435cc243cebd61244db1306dd1 2023-02-13 04:04:08,083 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/019da4435cc243cebd61244db1306dd1, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 04:04:08,083 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 7d918e7c28eead0044d9bb0dd30d1a51 in 41ms, sequenceid=5, compaction requested=false 2023-02-13 04:04:08,083 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-13 04:04:08,084 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7d918e7c28eead0044d9bb0dd30d1a51: 2023-02-13 04:04:08,084 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,084 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:04:08,084 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/cf7a0667593042909484a23596a376f8] hfiles 2023-02-13 04:04:08,084 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/cf7a0667593042909484a23596a376f8 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,084 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/019da4435cc243cebd61244db1306dd1] hfiles 2023-02-13 04:04:08,084 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/019da4435cc243cebd61244db1306dd1 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,091 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. completed. 2023-02-13 04:04:08,091 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,091 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 04:04:08,091 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 04:04:08,091 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,091 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 04:04:08,091 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38753,1676261046226' in zk 2023-02-13 04:04:08,093 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 04:04:08,093 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:08,093 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,093 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 04:04:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38753,1676261046226': 2023-02-13 04:04:08,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38753,1676261046226' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 04:04:08,096 INFO [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-13 04:04:08,096 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:04:08,096 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:04:08,096 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,096 INFO [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 04:04:08,098 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,098 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:08,098 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,098 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,098 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:08,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:08,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:08,098 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:08,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,100 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:08,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:08,101 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,102 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,108 DEBUG [Listener at localhost/46387] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:04:08,108 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,109 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:08,109 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:08,109 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,109 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:08,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,109 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,109 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:08,109 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:08,109 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:08,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-13 04:04:08,109 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:08,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:04:08,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:08,109 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:08,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:08,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,109 DEBUG [Listener at localhost/46387] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 04:04:08,109 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:08,110 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,110 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,110 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,137 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-13 04:04:08,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,137 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676261048006Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676261048109 (+103 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676261048109Writing data manifest for testWithMockedMapReduceSingleRegion at 1676261048112 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676261048118 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676261048137 (+19 ms) 2023-02-13 04:04:08,139 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 04:04:08,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 133 msec 2023-02-13 04:04:08,310 DEBUG [Listener at localhost/46387] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:04:08,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-13 04:04:08,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 04:04:08,311 INFO [Listener at localhost/46387] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 04:04:08,314 INFO [Listener at localhost/46387] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 04:04:08,319 INFO [Listener at localhost/46387] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 04:04:08,345 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38753] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,424 INFO [Listener at localhost/46387] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 04:04:08,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:04:08,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,432 INFO [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-13 04:04:08,432 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:08,433 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-13 04:04:08,433 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 04:04:08,433 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,433 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,434 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:08,434 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:08,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:08,434 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:08,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:08,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:08,435 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,435 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:04:08,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:04:08,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:04:08,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,436 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,436 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,436 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,436 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,436 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-13 04:04:08,436 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:08,436 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-13 04:04:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 04:04:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 04:04:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 04:04:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34745,1676261046199' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 04:04:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:04:08,437 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:04:08,437 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,438 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. started... 2023-02-13 04:04:08,438 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7d918e7c28eead0044d9bb0dd30d1a51 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 04:04:08,439 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,439 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,439 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:08,451 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/.tmp/f1/61adf3d6aca74ffa8a1a0d2910d3cb5f 2023-02-13 04:04:08,471 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/.tmp/f2/58f2bbd886e444ff874ba9837f84212d 2023-02-13 04:04:08,475 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/.tmp/f1/61adf3d6aca74ffa8a1a0d2910d3cb5f as hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/61adf3d6aca74ffa8a1a0d2910d3cb5f 2023-02-13 04:04:08,479 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/61adf3d6aca74ffa8a1a0d2910d3cb5f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 04:04:08,480 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/.tmp/f2/58f2bbd886e444ff874ba9837f84212d as hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/58f2bbd886e444ff874ba9837f84212d 2023-02-13 04:04:08,483 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/58f2bbd886e444ff874ba9837f84212d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 04:04:08,484 INFO [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 7d918e7c28eead0044d9bb0dd30d1a51 in 46ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:08,485 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7d918e7c28eead0044d9bb0dd30d1a51: 2023-02-13 04:04:08,485 DEBUG [rs(jenkins-hbase4.apache.org,38753,1676261046226)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,485 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:04:08,485 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:04:08,485 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,485 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 04:04:08,485 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38753,1676261046226' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 04:04:08,487 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,487 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:08,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:08,487 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:08,487 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:08,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38753,1676261046226' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-13 04:04:08,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63c26790[Count = 0] remaining members to acquire global barrier 2023-02-13 04:04:08,489 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 04:04:08,489 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,494 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,494 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,495 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 04:04:08,495 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 04:04:08,495 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 04:04:08,495 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,495 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:04:08,495 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38753,1676261046226' in zk 2023-02-13 04:04:08,495 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 04:04:08,495 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34745,1676261046199' in zk 2023-02-13 04:04:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 04:04:08,496 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 04:04:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,38753,1676261046226' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 04:04:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,34745,1676261046199' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 04:04:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38753,1676261046226': 2023-02-13 04:04:08,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38753,1676261046226' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 04:04:08,499 INFO [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-13 04:04:08,499 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:04:08,499 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:04:08,499 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,499 INFO [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:04:08,500 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,500 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,500 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:08,500 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:08,500 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:08,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:08,501 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:08,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,501 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:08,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,503 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:08,503 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,505 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,505 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:08,505 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:08,505 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:08,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:08,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-13 04:04:08,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:04:08,505 DEBUG [(jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:08,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:08,505 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:08,505 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:08,506 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,506 DEBUG [Listener at localhost/46387] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-13 04:04:08,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:08,506 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,506 DEBUG [Listener at localhost/46387] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:04:08,506 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:08,506 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,506 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,506 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,506 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,606 DEBUG [Listener at localhost/46387] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:04:08,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:04:08,611 INFO [Listener at localhost/46387] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676261047995 type: FLUSH version: 2 ttl: 0 2023-02-13 04:04:08,611 DEBUG [Listener at localhost/46387] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36705/user/jenkins/test-data/513f429e-5b11-aa58-3b12-7b12a4409b9d/testWithMockedMapReduceSingleRegion/dc269506-da39-456c-aa2c-cb3f6dabe5f4/data/default/testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,612 INFO [Listener at localhost/46387] snapshot.RestoreSnapshotHelper(239): region to add: 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:08,612 INFO [Listener at localhost/46387] snapshot.RestoreSnapshotHelper(585): clone region=7d918e7c28eead0044d9bb0dd30d1a51 as 7d918e7c28eead0044d9bb0dd30d1a51 in snapshot testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,613 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7d918e7c28eead0044d9bb0dd30d1a51, NAME => 'testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36705/user/jenkins/test-data/513f429e-5b11-aa58-3b12-7b12a4409b9d/testWithMockedMapReduceSingleRegion/dc269506-da39-456c-aa2c-cb3f6dabe5f4 2023-02-13 04:04:08,618 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:08,618 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cf7a0667593042909484a23596a376f8 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,620 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 019da4435cc243cebd61244db1306dd1 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,622 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 7d918e7c28eead0044d9bb0dd30d1a51, disabling compactions & flushes 2023-02-13 04:04:08,622 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,622 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,622 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. after waiting 0 ms 2023-02-13 04:04:08,622 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,622 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,622 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 7d918e7c28eead0044d9bb0dd30d1a51: Waiting for close lock at 1676261048622Disabling compacts and flushes for region at 1676261048622Disabling writes for close at 1676261048622Writing region close event to WAL at 1676261048622Closed at 1676261048622 2023-02-13 04:04:08,622 INFO [Listener at localhost/46387] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676261047995 type: FLUSH version: 2 ttl: 0 2023-02-13 04:04:08,622 DEBUG [Listener at localhost/46387] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36705/user/jenkins/test-data/513f429e-5b11-aa58-3b12-7b12a4409b9d/testWithMockedMapReduceSingleRegion/dc269506-da39-456c-aa2c-cb3f6dabe5f4 2023-02-13 04:04:08,622 DEBUG [Listener at localhost/46387] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36705/user/jenkins/test-data/513f429e-5b11-aa58-3b12-7b12a4409b9d/testWithMockedMapReduceSingleRegion/dc269506-da39-456c-aa2c-cb3f6dabe5f4 2023-02-13 04:04:08,623 DEBUG [Listener at localhost/46387] util.CommonFSUtils(699): |-data/ 2023-02-13 04:04:08,623 DEBUG [Listener at localhost/46387] util.CommonFSUtils(699): |----default/ 2023-02-13 04:04:08,623 DEBUG [Listener at localhost/46387] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-13 04:04:08,624 DEBUG [Listener at localhost/46387] util.CommonFSUtils(699): |----------7d918e7c28eead0044d9bb0dd30d1a51/ 2023-02-13 04:04:08,624 DEBUG [Listener at localhost/46387] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:08,624 DEBUG [Listener at localhost/46387] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:08,625 DEBUG [Listener at localhost/46387] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=7d918e7c28eead0044d9bb0dd30d1a51-cf7a0667593042909484a23596a376f8 2023-02-13 04:04:08,625 DEBUG [Listener at localhost/46387] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:08,625 DEBUG [Listener at localhost/46387] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=7d918e7c28eead0044d9bb0dd30d1a51-019da4435cc243cebd61244db1306dd1 2023-02-13 04:04:08,628 INFO [Listener at localhost/46387] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 04:04:08,632 DEBUG [Listener at localhost/46387] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:08,632 INFO [Listener at localhost/46387] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:08,635 DEBUG [Listener at localhost/46387] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:08,637 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:08,638 DEBUG [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/513f429e-5b11-aa58-3b12-7b12a4409b9d/testWithMockedMapReduceSingleRegion/dc269506-da39-456c-aa2c-cb3f6dabe5f4/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1 2023-02-13 04:04:08,638 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d918e7c28eead0044d9bb0dd30d1a51 columnFamilyName f1 2023-02-13 04:04:08,642 DEBUG [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] regionserver.HStore(539): loaded hdfs://localhost:36705/user/jenkins/test-data/513f429e-5b11-aa58-3b12-7b12a4409b9d/testWithMockedMapReduceSingleRegion/dc269506-da39-456c-aa2c-cb3f6dabe5f4/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/testWithMockedMapReduceSingleRegion=7d918e7c28eead0044d9bb0dd30d1a51-cf7a0667593042909484a23596a376f8 2023-02-13 04:04:08,642 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] regionserver.HStore(310): Store=7d918e7c28eead0044d9bb0dd30d1a51/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:08,642 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:08,643 DEBUG [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36705/user/jenkins/test-data/513f429e-5b11-aa58-3b12-7b12a4409b9d/testWithMockedMapReduceSingleRegion/dc269506-da39-456c-aa2c-cb3f6dabe5f4/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2 2023-02-13 04:04:08,643 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d918e7c28eead0044d9bb0dd30d1a51 columnFamilyName f2 2023-02-13 04:04:08,646 DEBUG [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] regionserver.HStore(539): loaded hdfs://localhost:36705/user/jenkins/test-data/513f429e-5b11-aa58-3b12-7b12a4409b9d/testWithMockedMapReduceSingleRegion/dc269506-da39-456c-aa2c-cb3f6dabe5f4/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/testWithMockedMapReduceSingleRegion=7d918e7c28eead0044d9bb0dd30d1a51-019da4435cc243cebd61244db1306dd1 2023-02-13 04:04:08,646 INFO [StoreOpener-7d918e7c28eead0044d9bb0dd30d1a51-1] regionserver.HStore(310): Store=7d918e7c28eead0044d9bb0dd30d1a51/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:08,646 DEBUG [Listener at localhost/46387] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:08,647 INFO [Listener at localhost/46387] regionserver.HRegion(1071): Opened 7d918e7c28eead0044d9bb0dd30d1a51; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67728730, jitterRate=0.009236723184585571}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:08,647 DEBUG [Listener at localhost/46387] regionserver.HRegion(964): Region open journal for 7d918e7c28eead0044d9bb0dd30d1a51: Writing region info on filesystem at 1676261048636Initializing all the Stores at 1676261048636Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261048636Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261048636Region opened successfully at 1676261048647 (+11 ms) 2023-02-13 04:04:08,692 DEBUG [Listener at localhost/46387] regionserver.HRegion(1603): Closing 7d918e7c28eead0044d9bb0dd30d1a51, disabling compactions & flushes 2023-02-13 04:04:08,692 INFO [Listener at localhost/46387] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,692 DEBUG [Listener at localhost/46387] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,692 DEBUG [Listener at localhost/46387] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. after waiting 0 ms 2023-02-13 04:04:08,692 DEBUG [Listener at localhost/46387] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,693 INFO [Listener at localhost/46387] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,693 DEBUG [Listener at localhost/46387] regionserver.HRegion(1557): Region close journal for 7d918e7c28eead0044d9bb0dd30d1a51: Waiting for close lock at 1676261048692Disabling compacts and flushes for region at 1676261048692Disabling writes for close at 1676261048692Writing region close event to WAL at 1676261048693 (+1 ms)Closed at 1676261048693 2023-02-13 04:04:08,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-13 04:04:08,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,700 INFO [Listener at localhost/46387] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:08,703 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261048703"}]},"ts":"1676261048703"} 2023-02-13 04:04:08,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:04:08,704 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-13 04:04:08,706 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-13 04:04:08,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=7d918e7c28eead0044d9bb0dd30d1a51, UNASSIGN}] 2023-02-13 04:04:08,708 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=7d918e7c28eead0044d9bb0dd30d1a51, UNASSIGN 2023-02-13 04:04:08,709 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7d918e7c28eead0044d9bb0dd30d1a51, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:08,709 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676261048709"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261048709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261048709"}]},"ts":"1676261048709"} 2023-02-13 04:04:08,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 7d918e7c28eead0044d9bb0dd30d1a51, server=jenkins-hbase4.apache.org,38753,1676261046226}] 2023-02-13 04:04:08,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:04:08,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:08,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7d918e7c28eead0044d9bb0dd30d1a51, disabling compactions & flushes 2023-02-13 04:04:08,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. after waiting 0 ms 2023-02-13 04:04:08,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:08,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51. 2023-02-13 04:04:08,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7d918e7c28eead0044d9bb0dd30d1a51: Waiting for close lock at 1676261048862Running coprocessor pre-close hooks at 1676261048862Disabling compacts and flushes for region at 1676261048862Disabling writes for close at 1676261048862Writing region close event to WAL at 1676261048863 (+1 ms)Running coprocessor post-close hooks at 1676261048866 (+3 ms)Closed at 1676261048866 2023-02-13 04:04:08,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:08,868 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7d918e7c28eead0044d9bb0dd30d1a51, regionState=CLOSED 2023-02-13 04:04:08,868 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676261048868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261048868"}]},"ts":"1676261048868"} 2023-02-13 04:04:08,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 04:04:08,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 7d918e7c28eead0044d9bb0dd30d1a51, server=jenkins-hbase4.apache.org,38753,1676261046226 in 159 msec 2023-02-13 04:04:08,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 04:04:08,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=7d918e7c28eead0044d9bb0dd30d1a51, UNASSIGN in 163 msec 2023-02-13 04:04:08,872 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261048871"}]},"ts":"1676261048871"} 2023-02-13 04:04:08,872 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-13 04:04:08,874 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-13 04:04:08,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 174 msec 2023-02-13 04:04:09,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:04:09,006 INFO [Listener at localhost/46387] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-13 04:04:09,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-13 04:04:09,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:09,009 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:09,010 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:09,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 04:04:09,013 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:09,014 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1, FileablePath, hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2, FileablePath, hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/recovered.edits] 2023-02-13 04:04:09,017 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/61adf3d6aca74ffa8a1a0d2910d3cb5f to hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/archive/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/61adf3d6aca74ffa8a1a0d2910d3cb5f 2023-02-13 04:04:09,018 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/cf7a0667593042909484a23596a376f8 to hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/archive/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f1/cf7a0667593042909484a23596a376f8 2023-02-13 04:04:09,020 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/019da4435cc243cebd61244db1306dd1 to hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/archive/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/019da4435cc243cebd61244db1306dd1 2023-02-13 04:04:09,021 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/58f2bbd886e444ff874ba9837f84212d to hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/archive/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/f2/58f2bbd886e444ff874ba9837f84212d 2023-02-13 04:04:09,024 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/recovered.edits/12.seqid to hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/archive/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51/recovered.edits/12.seqid 2023-02-13 04:04:09,024 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/.tmp/data/default/testWithMockedMapReduceSingleRegion/7d918e7c28eead0044d9bb0dd30d1a51 2023-02-13 04:04:09,024 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-13 04:04:09,026 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:09,027 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-13 04:04:09,029 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-13 04:04:09,029 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:09,029 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-13 04:04:09,029 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261049029"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:09,030 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 04:04:09,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7d918e7c28eead0044d9bb0dd30d1a51, NAME => 'testWithMockedMapReduceSingleRegion,,1676261047272.7d918e7c28eead0044d9bb0dd30d1a51.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 04:04:09,030 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-13 04:04:09,031 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676261049030"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:09,032 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-13 04:04:09,033 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 04:04:09,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-13 04:04:09,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38493] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 04:04:09,112 INFO [Listener at localhost/46387] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-13 04:04:09,112 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 04:04:09,112 INFO [Listener at localhost/46387] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:04:09,112 DEBUG [Listener at localhost/46387] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ce25144 to 127.0.0.1:63278 2023-02-13 04:04:09,112 DEBUG [Listener at localhost/46387] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:09,112 DEBUG [Listener at localhost/46387] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 04:04:09,113 DEBUG [Listener at localhost/46387] util.JVMClusterUtil(257): Found active master hash=630378816, stopped=false 2023-02-13 04:04:09,113 INFO [Listener at localhost/46387] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38493,1676261046150 2023-02-13 04:04:09,114 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:09,114 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:09,114 INFO [Listener at localhost/46387] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 04:04:09,114 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:09,114 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:09,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:09,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:09,116 DEBUG [Listener at localhost/46387] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22923e90 to 127.0.0.1:63278 2023-02-13 04:04:09,116 DEBUG [Listener at localhost/46387] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:09,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:09,116 INFO [Listener at localhost/46387] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34745,1676261046199' ***** 2023-02-13 04:04:09,116 INFO [Listener at localhost/46387] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:04:09,121 INFO [Listener at localhost/46387] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38753,1676261046226' ***** 2023-02-13 04:04:09,121 INFO [Listener at localhost/46387] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:04:09,121 INFO [RS:0;jenkins-hbase4:34745] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:04:09,121 INFO [RS:1;jenkins-hbase4:38753] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:04:09,121 INFO [RS:0;jenkins-hbase4:34745] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:04:09,121 INFO [RS:1;jenkins-hbase4:38753] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:04:09,121 INFO [RS:0;jenkins-hbase4:34745] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:04:09,121 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:04:09,122 INFO [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(3304): Received CLOSE for 0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:09,122 INFO [RS:1;jenkins-hbase4:38753] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:04:09,122 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:09,122 DEBUG [RS:1;jenkins-hbase4:38753] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x496bb479 to 127.0.0.1:63278 2023-02-13 04:04:09,121 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:04:09,122 INFO [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:09,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0bbe2f69137dddaa7e219eb7a06d8ea7, disabling compactions & flushes 2023-02-13 04:04:09,123 DEBUG [RS:0;jenkins-hbase4:34745] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d470a5e to 127.0.0.1:63278 2023-02-13 04:04:09,122 DEBUG [RS:1;jenkins-hbase4:38753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:09,123 INFO [RS:1;jenkins-hbase4:38753] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:04:09,123 INFO [RS:1;jenkins-hbase4:38753] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:04:09,123 INFO [RS:1;jenkins-hbase4:38753] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:04:09,123 DEBUG [RS:0;jenkins-hbase4:34745] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:09,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:09,123 INFO [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 04:04:09,123 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 04:04:09,124 DEBUG [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1479): Online Regions={0bbe2f69137dddaa7e219eb7a06d8ea7=hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7.} 2023-02-13 04:04:09,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:09,124 DEBUG [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1505): Waiting on 0bbe2f69137dddaa7e219eb7a06d8ea7 2023-02-13 04:04:09,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. after waiting 0 ms 2023-02-13 04:04:09,124 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 04:04:09,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:09,124 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 04:04:09,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 0bbe2f69137dddaa7e219eb7a06d8ea7 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 04:04:09,124 DEBUG [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 04:04:09,124 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:04:09,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:04:09,124 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:04:09,124 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:04:09,124 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:04:09,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-13 04:04:09,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7/.tmp/info/7177ee75ad334c3795e49f08b2330b26 2023-02-13 04:04:09,132 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/.tmp/info/48fabfd3d96c42c4b56acc980971b555 2023-02-13 04:04:09,136 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48fabfd3d96c42c4b56acc980971b555 2023-02-13 04:04:09,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7/.tmp/info/7177ee75ad334c3795e49f08b2330b26 as hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7/info/7177ee75ad334c3795e49f08b2330b26 2023-02-13 04:04:09,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7/info/7177ee75ad334c3795e49f08b2330b26, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 04:04:09,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0bbe2f69137dddaa7e219eb7a06d8ea7 in 17ms, sequenceid=6, compaction requested=false 2023-02-13 04:04:09,143 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/.tmp/rep_barrier/f9fa30643a1c4056bde4ac4a4c2eb4d2 2023-02-13 04:04:09,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/namespace/0bbe2f69137dddaa7e219eb7a06d8ea7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 04:04:09,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:09,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0bbe2f69137dddaa7e219eb7a06d8ea7: Waiting for close lock at 1676261049123Running coprocessor pre-close hooks at 1676261049123Disabling compacts and flushes for region at 1676261049123Disabling writes for close at 1676261049124 (+1 ms)Obtaining lock to block concurrent updates at 1676261049124Preparing flush snapshotting stores in 0bbe2f69137dddaa7e219eb7a06d8ea7 at 1676261049124Finished memstore snapshotting hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676261049124Flushing stores of hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. at 1676261049124Flushing 0bbe2f69137dddaa7e219eb7a06d8ea7/info: creating writer at 1676261049125 (+1 ms)Flushing 0bbe2f69137dddaa7e219eb7a06d8ea7/info: appending metadata at 1676261049127 (+2 ms)Flushing 0bbe2f69137dddaa7e219eb7a06d8ea7/info: closing flushed file at 1676261049127Flushing 0bbe2f69137dddaa7e219eb7a06d8ea7/info: reopening flushed file at 1676261049137 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0bbe2f69137dddaa7e219eb7a06d8ea7 in 17ms, sequenceid=6, compaction requested=false at 1676261049141 (+4 ms)Writing region close event to WAL at 1676261049142 (+1 ms)Running coprocessor post-close hooks at 1676261049145 (+3 ms)Closed at 1676261049145 2023-02-13 04:04:09,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676261046788.0bbe2f69137dddaa7e219eb7a06d8ea7. 2023-02-13 04:04:09,146 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9fa30643a1c4056bde4ac4a4c2eb4d2 2023-02-13 04:04:09,157 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/.tmp/table/0ae093f82c7e4192b92c3bd0c37b79ae 2023-02-13 04:04:09,160 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ae093f82c7e4192b92c3bd0c37b79ae 2023-02-13 04:04:09,160 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/.tmp/info/48fabfd3d96c42c4b56acc980971b555 as hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/info/48fabfd3d96c42c4b56acc980971b555 2023-02-13 04:04:09,164 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 48fabfd3d96c42c4b56acc980971b555 2023-02-13 04:04:09,164 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/info/48fabfd3d96c42c4b56acc980971b555, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 04:04:09,164 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/.tmp/rep_barrier/f9fa30643a1c4056bde4ac4a4c2eb4d2 as hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/rep_barrier/f9fa30643a1c4056bde4ac4a4c2eb4d2 2023-02-13 04:04:09,167 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9fa30643a1c4056bde4ac4a4c2eb4d2 2023-02-13 04:04:09,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/rep_barrier/f9fa30643a1c4056bde4ac4a4c2eb4d2, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 04:04:09,168 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/.tmp/table/0ae093f82c7e4192b92c3bd0c37b79ae as hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/table/0ae093f82c7e4192b92c3bd0c37b79ae 2023-02-13 04:04:09,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ae093f82c7e4192b92c3bd0c37b79ae 2023-02-13 04:04:09,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/table/0ae093f82c7e4192b92c3bd0c37b79ae, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 04:04:09,174 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 50ms, sequenceid=21, compaction requested=false 2023-02-13 04:04:09,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 04:04:09,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 04:04:09,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:09,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261049124Running coprocessor pre-close hooks at 1676261049124Disabling compacts and flushes for region at 1676261049124Disabling writes for close at 1676261049124Obtaining lock to block concurrent updates at 1676261049124Preparing flush snapshotting stores in 1588230740 at 1676261049124Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676261049124Flushing stores of hbase:meta,,1.1588230740 at 1676261049125 (+1 ms)Flushing 1588230740/info: creating writer at 1676261049125Flushing 1588230740/info: appending metadata at 1676261049127 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676261049127Flushing 1588230740/rep_barrier: creating writer at 1676261049136 (+9 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676261049138 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676261049138Flushing 1588230740/table: creating writer at 1676261049146 (+8 ms)Flushing 1588230740/table: appending metadata at 1676261049148 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676261049148Flushing 1588230740/info: reopening flushed file at 1676261049161 (+13 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676261049165 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676261049168 (+3 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 50ms, sequenceid=21, compaction requested=false at 1676261049174 (+6 ms)Writing region close event to WAL at 1676261049175 (+1 ms)Running coprocessor post-close hooks at 1676261049177 (+2 ms)Closed at 1676261049177 2023-02-13 04:04:09,178 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:09,215 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:09,215 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:09,324 INFO [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34745,1676261046199; all regions closed. 2023-02-13 04:04:09,324 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38753,1676261046226; all regions closed. 2023-02-13 04:04:09,328 DEBUG [RS:0;jenkins-hbase4:34745] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/oldWALs 2023-02-13 04:04:09,328 DEBUG [RS:1;jenkins-hbase4:38753] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/oldWALs 2023-02-13 04:04:09,328 INFO [RS:1;jenkins-hbase4:38753] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38753%2C1676261046226.meta:.meta(num 1676261046734) 2023-02-13 04:04:09,328 INFO [RS:0;jenkins-hbase4:34745] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34745%2C1676261046199:(num 1676261047132) 2023-02-13 04:04:09,328 DEBUG [RS:0;jenkins-hbase4:34745] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:09,328 INFO [RS:0;jenkins-hbase4:34745] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:09,329 INFO [RS:0;jenkins-hbase4:34745] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 04:04:09,329 INFO [RS:0;jenkins-hbase4:34745] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:04:09,329 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:09,329 INFO [RS:0;jenkins-hbase4:34745] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:04:09,329 INFO [RS:0;jenkins-hbase4:34745] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:04:09,330 INFO [RS:0;jenkins-hbase4:34745] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34745 2023-02-13 04:04:09,332 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:09,332 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:09,332 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34745,1676261046199 2023-02-13 04:04:09,332 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:09,332 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:09,332 ERROR [Listener at localhost/46387-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ef0ea95 rejected from java.util.concurrent.ThreadPoolExecutor@3acf6993[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:09,333 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34745,1676261046199] 2023-02-13 04:04:09,333 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34745,1676261046199; numProcessing=1 2023-02-13 04:04:09,334 DEBUG [RS:1;jenkins-hbase4:38753] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/oldWALs 2023-02-13 04:04:09,334 INFO [RS:1;jenkins-hbase4:38753] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38753%2C1676261046226:(num 1676261047537) 2023-02-13 04:04:09,334 DEBUG [RS:1;jenkins-hbase4:38753] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:09,334 INFO [RS:1;jenkins-hbase4:38753] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:09,334 INFO [RS:1;jenkins-hbase4:38753] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 04:04:09,334 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:09,335 INFO [RS:1;jenkins-hbase4:38753] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38753 2023-02-13 04:04:09,336 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34745,1676261046199 already deleted, retry=false 2023-02-13 04:04:09,336 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34745,1676261046199 expired; onlineServers=1 2023-02-13 04:04:09,336 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38753,1676261046226 2023-02-13 04:04:09,336 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:09,337 ERROR [Listener at localhost/46387-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12b41929 rejected from java.util.concurrent.ThreadPoolExecutor@168b8fa7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:09,338 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38753,1676261046226] 2023-02-13 04:04:09,338 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38753,1676261046226; numProcessing=2 2023-02-13 04:04:09,338 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38753,1676261046226 already deleted, retry=false 2023-02-13 04:04:09,339 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38753,1676261046226 expired; onlineServers=0 2023-02-13 04:04:09,339 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38493,1676261046150' ***** 2023-02-13 04:04:09,339 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 04:04:09,339 DEBUG [M:0;jenkins-hbase4:38493] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21ad412a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:04:09,339 INFO [M:0;jenkins-hbase4:38493] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38493,1676261046150 2023-02-13 04:04:09,339 INFO [M:0;jenkins-hbase4:38493] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38493,1676261046150; all regions closed. 2023-02-13 04:04:09,339 DEBUG [M:0;jenkins-hbase4:38493] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:09,339 DEBUG [M:0;jenkins-hbase4:38493] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 04:04:09,340 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 04:04:09,340 DEBUG [M:0;jenkins-hbase4:38493] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 04:04:09,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261046392] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261046392,5,FailOnTimeoutGroup] 2023-02-13 04:04:09,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261046392] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261046392,5,FailOnTimeoutGroup] 2023-02-13 04:04:09,340 INFO [M:0;jenkins-hbase4:38493] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 04:04:09,341 INFO [M:0;jenkins-hbase4:38493] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 04:04:09,341 INFO [M:0;jenkins-hbase4:38493] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 04:04:09,341 DEBUG [M:0;jenkins-hbase4:38493] master.HMaster(1502): Stopping service threads 2023-02-13 04:04:09,341 INFO [M:0;jenkins-hbase4:38493] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 04:04:09,342 ERROR [M:0;jenkins-hbase4:38493] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 04:04:09,342 INFO [M:0;jenkins-hbase4:38493] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 04:04:09,342 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 04:04:09,342 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:09,342 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:09,342 DEBUG [M:0;jenkins-hbase4:38493] zookeeper.ZKUtil(398): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 04:04:09,342 WARN [M:0;jenkins-hbase4:38493] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 04:04:09,342 INFO [M:0;jenkins-hbase4:38493] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 04:04:09,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:09,343 INFO [M:0;jenkins-hbase4:38493] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 04:04:09,343 DEBUG [M:0;jenkins-hbase4:38493] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:04:09,343 INFO [M:0;jenkins-hbase4:38493] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:09,343 DEBUG [M:0;jenkins-hbase4:38493] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:09,343 DEBUG [M:0;jenkins-hbase4:38493] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:04:09,343 DEBUG [M:0;jenkins-hbase4:38493] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:09,343 INFO [M:0;jenkins-hbase4:38493] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.12 KB heapSize=67.06 KB 2023-02-13 04:04:09,354 INFO [M:0;jenkins-hbase4:38493] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.12 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c52a879e6c3d4b769357824a09479550 2023-02-13 04:04:09,357 DEBUG [M:0;jenkins-hbase4:38493] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c52a879e6c3d4b769357824a09479550 as hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c52a879e6c3d4b769357824a09479550 2023-02-13 04:04:09,361 INFO [M:0;jenkins-hbase4:38493] regionserver.HStore(1080): Added hdfs://localhost:36705/user/jenkins/test-data/9d401116-88ef-fd15-4868-616ad5e40ba1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c52a879e6c3d4b769357824a09479550, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 04:04:09,362 INFO [M:0;jenkins-hbase4:38493] regionserver.HRegion(2947): Finished flush of dataSize ~56.12 KB/57463, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-13 04:04:09,364 INFO [M:0;jenkins-hbase4:38493] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:09,364 DEBUG [M:0;jenkins-hbase4:38493] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261049343Disabling compacts and flushes for region at 1676261049343Disabling writes for close at 1676261049343Obtaining lock to block concurrent updates at 1676261049343Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676261049343Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57463, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1676261049343Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676261049344 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676261049345 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676261049347 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676261049347Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676261049358 (+11 ms)Finished flush of dataSize ~56.12 KB/57463, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false at 1676261049362 (+4 ms)Writing region close event to WAL at 1676261049364 (+2 ms)Closed at 1676261049364 2023-02-13 04:04:09,368 INFO [M:0;jenkins-hbase4:38493] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 04:04:09,368 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:09,369 INFO [M:0;jenkins-hbase4:38493] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38493 2023-02-13 04:04:09,371 DEBUG [M:0;jenkins-hbase4:38493] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38493,1676261046150 already deleted, retry=false 2023-02-13 04:04:09,616 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:09,616 INFO [M:0;jenkins-hbase4:38493] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38493,1676261046150; zookeeper connection closed. 2023-02-13 04:04:09,616 ERROR [Listener at localhost/46387-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22e2cd8c rejected from java.util.concurrent.ThreadPoolExecutor@26dd5d08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:09,617 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): master:38493-0x1004bd9a13a0000, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:09,617 ERROR [Listener at localhost/46387-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@664cbb42 rejected from java.util.concurrent.ThreadPoolExecutor@26dd5d08[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:09,645 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 04:04:09,717 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:09,717 INFO [RS:1;jenkins-hbase4:38753] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38753,1676261046226; zookeeper connection closed. 2023-02-13 04:04:09,717 ERROR [Listener at localhost/46387-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@505f00e8 rejected from java.util.concurrent.ThreadPoolExecutor@168b8fa7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:09,719 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@211ebe26] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@211ebe26 2023-02-13 04:04:09,719 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:38753-0x1004bd9a13a0002, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:09,719 ERROR [Listener at localhost/46387-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@282c6bc9 rejected from java.util.concurrent.ThreadPoolExecutor@168b8fa7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:09,817 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:09,817 INFO [RS:0;jenkins-hbase4:34745] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34745,1676261046199; zookeeper connection closed. 2023-02-13 04:04:09,817 ERROR [Listener at localhost/46387-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@77e5d5ae rejected from java.util.concurrent.ThreadPoolExecutor@3acf6993[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:09,817 DEBUG [Listener at localhost/46387-EventThread] zookeeper.ZKWatcher(600): regionserver:34745-0x1004bd9a13a0001, quorum=127.0.0.1:63278, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:09,817 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@568ead2b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@568ead2b 2023-02-13 04:04:09,817 ERROR [Listener at localhost/46387-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f3a5638 rejected from java.util.concurrent.ThreadPoolExecutor@3acf6993[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:09,817 INFO [Listener at localhost/46387] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 04:04:09,818 WARN [Listener at localhost/46387] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:04:09,822 INFO [Listener at localhost/46387] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:09,927 WARN [BP-1759023338-172.31.14.131-1676261045555 heartbeating to localhost/127.0.0.1:36705] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:04:09,928 WARN [BP-1759023338-172.31.14.131-1676261045555 heartbeating to localhost/127.0.0.1:36705] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1759023338-172.31.14.131-1676261045555 (Datanode Uuid a05266a0-4978-468b-8e48-898e04c250c3) service to localhost/127.0.0.1:36705 2023-02-13 04:04:09,928 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/cluster_835efd3d-6a72-85ba-2da8-9311b86812dd/dfs/data/data3/current/BP-1759023338-172.31.14.131-1676261045555] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:09,929 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/cluster_835efd3d-6a72-85ba-2da8-9311b86812dd/dfs/data/data4/current/BP-1759023338-172.31.14.131-1676261045555] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:09,930 WARN [Listener at localhost/46387] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:04:09,933 INFO [Listener at localhost/46387] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:10,037 WARN [BP-1759023338-172.31.14.131-1676261045555 heartbeating to localhost/127.0.0.1:36705] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:04:10,037 WARN [BP-1759023338-172.31.14.131-1676261045555 heartbeating to localhost/127.0.0.1:36705] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1759023338-172.31.14.131-1676261045555 (Datanode Uuid 7defdfea-345e-4541-9409-6110c0c88661) service to localhost/127.0.0.1:36705 2023-02-13 04:04:10,038 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/cluster_835efd3d-6a72-85ba-2da8-9311b86812dd/dfs/data/data1/current/BP-1759023338-172.31.14.131-1676261045555] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:10,038 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/cluster_835efd3d-6a72-85ba-2da8-9311b86812dd/dfs/data/data2/current/BP-1759023338-172.31.14.131-1676261045555] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:10,048 INFO [Listener at localhost/46387] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:10,161 INFO [Listener at localhost/46387] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 04:04:10,174 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 04:04:10,186 INFO [Listener at localhost/46387] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=253 (was 230) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:36705 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36705 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46387.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46387 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:36705 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:36705 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:36705 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:36705 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38493,1676261046150)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:36705 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=661 (was 636) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 268), ProcessCount=168 (was 168), AvailableMemoryMB=3844 (was 3879) 2023-02-13 04:04:10,196 INFO [Listener at localhost/46387] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=253, OpenFileDescriptor=661, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=168, AvailableMemoryMB=3843 2023-02-13 04:04:10,206 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/hadoop.log.dir so I do NOT create it in target/test-data/02327637-08d5-62f2-536a-401e8cf50aec 2023-02-13 04:04:10,206 WARN [Listener at localhost/46387] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 04:04:10,206 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/hadoop.tmp.dir so I do NOT create it in target/test-data/02327637-08d5-62f2-536a-401e8cf50aec 2023-02-13 04:04:10,206 WARN [Listener at localhost/46387] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1e078708-4782-82a5-e0fb-17c30dd2f5e4/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 04:04:10,206 DEBUG [Listener at localhost/46387] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec 2023-02-13 04:04:10,207 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 04:04:10,207 INFO [Listener at localhost/46387] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/cluster_3f28eb11-a6b9-bea6-a231-eb5a4aff9cb4, deleteOnExit=true 2023-02-13 04:04:10,207 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 04:04:10,207 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/test.cache.data in system properties and HBase conf 2023-02-13 04:04:10,207 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 04:04:10,207 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/hadoop.log.dir in system properties and HBase conf 2023-02-13 04:04:10,207 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 04:04:10,207 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 04:04:10,207 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 04:04:10,207 DEBUG [Listener at localhost/46387] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/nfs.dump.dir in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/java.io.tmpdir in system properties and HBase conf 2023-02-13 04:04:10,208 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:04:10,209 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 04:04:10,209 INFO [Listener at localhost/46387] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 04:04:10,213 WARN [Listener at localhost/46387] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:04:10,213 WARN [Listener at localhost/46387] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:04:10,256 WARN [Listener at localhost/46387] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:04:10,259 INFO [Listener at localhost/46387] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:04:10,263 INFO [Listener at localhost/46387] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/java.io.tmpdir/Jetty_localhost_36935_hdfs____.9ayn26/webapp 2023-02-13 04:04:10,355 INFO [Listener at localhost/46387] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36935 2023-02-13 04:04:10,396 WARN [Listener at localhost/46387] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:04:10,396 WARN [Listener at localhost/46387] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:04:10,443 WARN [Listener at localhost/35745] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:04:10,458 WARN [Listener at localhost/35745] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:04:10,462 WARN [Listener at localhost/35745] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:04:10,463 INFO [Listener at localhost/35745] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:04:10,467 INFO [Listener at localhost/35745] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/java.io.tmpdir/Jetty_localhost_37939_datanode____g9cbfm/webapp 2023-02-13 04:04:10,558 INFO [Listener at localhost/35745] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37939 2023-02-13 04:04:10,566 WARN [Listener at localhost/34351] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:04:10,579 WARN [Listener at localhost/34351] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:04:10,582 WARN [Listener at localhost/34351] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:04:10,583 INFO [Listener at localhost/34351] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:04:10,587 INFO [Listener at localhost/34351] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/java.io.tmpdir/Jetty_localhost_40707_datanode____bmwsx5/webapp 2023-02-13 04:04:10,658 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfc386c07313e2946: Processing first storage report for DS-6e97dc3a-cc6b-4cc9-ba69-39993bff670f from datanode 2e4962fc-13f1-4791-a712-2fb840c60881 2023-02-13 04:04:10,658 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfc386c07313e2946: from storage DS-6e97dc3a-cc6b-4cc9-ba69-39993bff670f node DatanodeRegistration(127.0.0.1:34353, datanodeUuid=2e4962fc-13f1-4791-a712-2fb840c60881, infoPort=44021, infoSecurePort=0, ipcPort=34351, storageInfo=lv=-57;cid=testClusterID;nsid=924183260;c=1676261050215), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-13 04:04:10,658 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfc386c07313e2946: Processing first storage report for DS-787c7456-2e6f-4af7-882e-4a4a682fcb20 from datanode 2e4962fc-13f1-4791-a712-2fb840c60881 2023-02-13 04:04:10,658 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfc386c07313e2946: from storage DS-787c7456-2e6f-4af7-882e-4a4a682fcb20 node DatanodeRegistration(127.0.0.1:34353, datanodeUuid=2e4962fc-13f1-4791-a712-2fb840c60881, infoPort=44021, infoSecurePort=0, ipcPort=34351, storageInfo=lv=-57;cid=testClusterID;nsid=924183260;c=1676261050215), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:04:10,705 INFO [Listener at localhost/34351] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40707 2023-02-13 04:04:10,713 WARN [Listener at localhost/41441] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:04:10,811 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x743facb6347ce42c: Processing first storage report for DS-83d99dfa-6b34-413c-b0a5-869fa7a2590d from datanode bae9d68e-ca1e-4f02-8c53-933d6b68aa42 2023-02-13 04:04:10,811 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x743facb6347ce42c: from storage DS-83d99dfa-6b34-413c-b0a5-869fa7a2590d node DatanodeRegistration(127.0.0.1:36485, datanodeUuid=bae9d68e-ca1e-4f02-8c53-933d6b68aa42, infoPort=39723, infoSecurePort=0, ipcPort=41441, storageInfo=lv=-57;cid=testClusterID;nsid=924183260;c=1676261050215), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:04:10,811 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x743facb6347ce42c: Processing first storage report for DS-e3fbf7a3-f384-4b5d-b714-31bfccf9f25f from datanode bae9d68e-ca1e-4f02-8c53-933d6b68aa42 2023-02-13 04:04:10,811 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x743facb6347ce42c: from storage DS-e3fbf7a3-f384-4b5d-b714-31bfccf9f25f node DatanodeRegistration(127.0.0.1:36485, datanodeUuid=bae9d68e-ca1e-4f02-8c53-933d6b68aa42, infoPort=39723, infoSecurePort=0, ipcPort=41441, storageInfo=lv=-57;cid=testClusterID;nsid=924183260;c=1676261050215), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:04:10,819 DEBUG [Listener at localhost/41441] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec 2023-02-13 04:04:10,821 INFO [Listener at localhost/41441] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/cluster_3f28eb11-a6b9-bea6-a231-eb5a4aff9cb4/zookeeper_0, clientPort=60098, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/cluster_3f28eb11-a6b9-bea6-a231-eb5a4aff9cb4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/cluster_3f28eb11-a6b9-bea6-a231-eb5a4aff9cb4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 04:04:10,822 INFO [Listener at localhost/41441] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60098 2023-02-13 04:04:10,823 INFO [Listener at localhost/41441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,823 INFO [Listener at localhost/41441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,836 INFO [Listener at localhost/41441] util.FSUtils(479): Created version file at hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46 with version=8 2023-02-13 04:04:10,836 INFO [Listener at localhost/41441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,837 INFO [Listener at localhost/41441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,839 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35745/user/jenkins/test-data/5b444e10-7105-31a0-cd74-fcc7a00d3b3d/hbase-staging 2023-02-13 04:04:10,841 INFO [Listener at localhost/41441] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:04:10,841 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:10,841 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:10,841 INFO [Listener at localhost/41441] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:04:10,841 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:10,841 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:04:10,842 INFO [Listener at localhost/41441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:04:10,843 INFO [Listener at localhost/41441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41243 2023-02-13 04:04:10,843 INFO [Listener at localhost/41441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,844 INFO [Listener at localhost/41441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,845 INFO [Listener at localhost/41441] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41243 connecting to ZooKeeper ensemble=127.0.0.1:60098 2023-02-13 04:04:10,852 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:412430x0, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:04:10,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41243-0x1004bd9b3890000 connected 2023-02-13 04:04:10,873 DEBUG [Listener at localhost/41441] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:10,874 DEBUG [Listener at localhost/41441] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:10,874 DEBUG [Listener at localhost/41441] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:04:10,874 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41243 2023-02-13 04:04:10,875 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41243 2023-02-13 04:04:10,875 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41243 2023-02-13 04:04:10,879 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41243 2023-02-13 04:04:10,879 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41243 2023-02-13 04:04:10,879 INFO [Listener at localhost/41441] master.HMaster(439): hbase.rootdir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46, hbase.cluster.distributed=false 2023-02-13 04:04:10,890 INFO [Listener at localhost/41441] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:04:10,890 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:10,891 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:10,891 INFO [Listener at localhost/41441] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:04:10,891 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:10,891 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:04:10,891 INFO [Listener at localhost/41441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:04:10,892 INFO [Listener at localhost/41441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41191 2023-02-13 04:04:10,892 INFO [Listener at localhost/41441] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:04:10,894 DEBUG [Listener at localhost/41441] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:10,894 INFO [Listener at localhost/41441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,895 INFO [Listener at localhost/41441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,896 INFO [Listener at localhost/41441] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41191 connecting to ZooKeeper ensemble=127.0.0.1:60098 2023-02-13 04:04:10,900 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:411910x0, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:04:10,901 DEBUG [Listener at localhost/41441] zookeeper.ZKUtil(164): regionserver:411910x0, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:10,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41191-0x1004bd9b3890001 connected 2023-02-13 04:04:10,902 DEBUG [Listener at localhost/41441] zookeeper.ZKUtil(164): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:10,902 DEBUG [Listener at localhost/41441] zookeeper.ZKUtil(164): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:04:10,903 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41191 2023-02-13 04:04:10,904 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41191 2023-02-13 04:04:10,905 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41191 2023-02-13 04:04:10,907 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41191 2023-02-13 04:04:10,908 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41191 2023-02-13 04:04:10,918 INFO [Listener at localhost/41441] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:04:10,918 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:10,918 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:10,918 INFO [Listener at localhost/41441] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:04:10,918 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:10,918 INFO [Listener at localhost/41441] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:04:10,918 INFO [Listener at localhost/41441] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:04:10,919 INFO [Listener at localhost/41441] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36419 2023-02-13 04:04:10,919 INFO [Listener at localhost/41441] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:04:10,920 DEBUG [Listener at localhost/41441] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:10,920 INFO [Listener at localhost/41441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,921 INFO [Listener at localhost/41441] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,922 INFO [Listener at localhost/41441] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36419 connecting to ZooKeeper ensemble=127.0.0.1:60098 2023-02-13 04:04:10,924 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:364190x0, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:04:10,924 DEBUG [Listener at localhost/41441] zookeeper.ZKUtil(164): regionserver:364190x0, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:10,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36419-0x1004bd9b3890002 connected 2023-02-13 04:04:10,925 DEBUG [Listener at localhost/41441] zookeeper.ZKUtil(164): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:10,926 DEBUG [Listener at localhost/41441] zookeeper.ZKUtil(164): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:04:10,928 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36419 2023-02-13 04:04:10,928 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36419 2023-02-13 04:04:10,929 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36419 2023-02-13 04:04:10,932 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36419 2023-02-13 04:04:10,932 DEBUG [Listener at localhost/41441] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36419 2023-02-13 04:04:10,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41243,1676261050840 2023-02-13 04:04:10,936 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:04:10,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41243,1676261050840 2023-02-13 04:04:10,937 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:10,937 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:10,937 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:10,938 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:10,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:04:10,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41243,1676261050840 from backup master directory 2023-02-13 04:04:10,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:04:10,941 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41243,1676261050840 2023-02-13 04:04:10,941 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:04:10,941 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:04:10,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41243,1676261050840 2023-02-13 04:04:10,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/hbase.id with ID: 4d0c5aac-a0ea-4924-8510-c6b889483003 2023-02-13 04:04:10,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:10,965 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:10,974 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x00b9cf17 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:10,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f4eb85c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:10,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:10,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 04:04:10,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:10,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/data/master/store-tmp 2023-02-13 04:04:10,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:10,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:04:10,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:10,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:10,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:04:10,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:10,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:10,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261050990Disabling compacts and flushes for region at 1676261050990Disabling writes for close at 1676261050990Writing region close event to WAL at 1676261050990Closed at 1676261050990 2023-02-13 04:04:10,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/WALs/jenkins-hbase4.apache.org,41243,1676261050840 2023-02-13 04:04:10,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41243%2C1676261050840, suffix=, logDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/WALs/jenkins-hbase4.apache.org,41243,1676261050840, archiveDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/oldWALs, maxLogs=10 2023-02-13 04:04:11,004 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34353,DS-6e97dc3a-cc6b-4cc9-ba69-39993bff670f,DISK] 2023-02-13 04:04:11,004 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36485,DS-83d99dfa-6b34-413c-b0a5-869fa7a2590d,DISK] 2023-02-13 04:04:11,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/WALs/jenkins-hbase4.apache.org,41243,1676261050840/jenkins-hbase4.apache.org%2C41243%2C1676261050840.1676261050992 2023-02-13 04:04:11,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34353,DS-6e97dc3a-cc6b-4cc9-ba69-39993bff670f,DISK], DatanodeInfoWithStorage[127.0.0.1:36485,DS-83d99dfa-6b34-413c-b0a5-869fa7a2590d,DISK]] 2023-02-13 04:04:11,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:11,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:11,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:11,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:11,007 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:11,008 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 04:04:11,008 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 04:04:11,009 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:11,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:11,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:11,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:11,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:11,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74566105, jitterRate=0.11112155020236969}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:04:11,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676261051006Initializing all the Stores at 1676261051007 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261051007Cleaning up temporary data from old regions at 1676261051009 (+2 ms)Cleaning up detritus from prior splits at 1676261051010 (+1 ms)Region opened successfully at 1676261051013 (+3 ms) 2023-02-13 04:04:11,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 04:04:11,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 04:04:11,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 04:04:11,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 04:04:11,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 04:04:11,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 04:04:11,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 04:04:11,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 04:04:11,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 04:04:11,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 04:04:11,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 04:04:11,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 04:04:11,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 04:04:11,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 04:04:11,029 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:11,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 04:04:11,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 04:04:11,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 04:04:11,031 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:11,031 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:11,031 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:11,031 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:11,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41243,1676261050840, sessionid=0x1004bd9b3890000, setting cluster-up flag (Was=false) 2023-02-13 04:04:11,037 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:11,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 04:04:11,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41243,1676261050840 2023-02-13 04:04:11,045 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:11,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 04:04:11,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41243,1676261050840 2023-02-13 04:04:11,052 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.hbase-snapshot/.tmp 2023-02-13 04:04:11,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 04:04:11,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:11,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:11,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:11,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:11,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 04:04:11,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:04:11,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676261081055 2023-02-13 04:04:11,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 04:04:11,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 04:04:11,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 04:04:11,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 04:04:11,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 04:04:11,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 04:04:11,056 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:04:11,056 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 04:04:11,057 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:11,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 04:04:11,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 04:04:11,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 04:04:11,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 04:04:11,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 04:04:11,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261051058,5,FailOnTimeoutGroup] 2023-02-13 04:04:11,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261051060,5,FailOnTimeoutGroup] 2023-02-13 04:04:11,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 04:04:11,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,070 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:11,070 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:11,071 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46 2023-02-13 04:04:11,077 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:11,078 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:04:11,079 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/info 2023-02-13 04:04:11,079 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:04:11,080 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:11,080 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:04:11,081 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:04:11,081 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:04:11,081 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:11,081 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:04:11,082 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/table 2023-02-13 04:04:11,082 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:04:11,082 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:11,083 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740 2023-02-13 04:04:11,083 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740 2023-02-13 04:04:11,085 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:04:11,085 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:04:11,087 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:11,087 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62238539, jitterRate=-0.07257349789142609}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:04:11,087 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676261051078Initializing all the Stores at 1676261051078Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261051078Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261051078Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261051078Cleaning up temporary data from old regions at 1676261051084 (+6 ms)Cleaning up detritus from prior splits at 1676261051084Region opened successfully at 1676261051087 (+3 ms) 2023-02-13 04:04:11,087 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:04:11,087 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:04:11,087 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:04:11,087 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:04:11,087 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:04:11,087 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:11,087 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261051087Disabling compacts and flushes for region at 1676261051087Disabling writes for close at 1676261051087Writing region close event to WAL at 1676261051087Closed at 1676261051087 2023-02-13 04:04:11,088 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:04:11,088 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 04:04:11,088 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 04:04:11,090 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 04:04:11,091 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 04:04:11,134 INFO [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(952): ClusterId : 4d0c5aac-a0ea-4924-8510-c6b889483003 2023-02-13 04:04:11,134 INFO [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(952): ClusterId : 4d0c5aac-a0ea-4924-8510-c6b889483003 2023-02-13 04:04:11,134 DEBUG [RS:0;jenkins-hbase4:41191] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:04:11,134 DEBUG [RS:1;jenkins-hbase4:36419] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:04:11,136 DEBUG [RS:0;jenkins-hbase4:41191] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:04:11,136 DEBUG [RS:0;jenkins-hbase4:41191] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:04:11,136 DEBUG [RS:1;jenkins-hbase4:36419] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:04:11,136 DEBUG [RS:1;jenkins-hbase4:36419] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:04:11,138 DEBUG [RS:0;jenkins-hbase4:41191] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:04:11,139 DEBUG [RS:1;jenkins-hbase4:36419] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:04:11,139 DEBUG [RS:0;jenkins-hbase4:41191] zookeeper.ReadOnlyZKClient(139): Connect 0x5e804415 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:11,139 DEBUG [RS:1;jenkins-hbase4:36419] zookeeper.ReadOnlyZKClient(139): Connect 0x54cb8a50 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:11,143 DEBUG [RS:1;jenkins-hbase4:36419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a0c7eb9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:11,143 DEBUG [RS:0;jenkins-hbase4:41191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5047a1b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:11,143 DEBUG [RS:1;jenkins-hbase4:36419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e33e120, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:04:11,144 DEBUG [RS:0;jenkins-hbase4:41191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54782f65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:04:11,152 DEBUG [RS:1;jenkins-hbase4:36419] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36419 2023-02-13 04:04:11,152 INFO [RS:1;jenkins-hbase4:36419] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:04:11,152 INFO [RS:1;jenkins-hbase4:36419] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:04:11,152 DEBUG [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:04:11,152 INFO [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41243,1676261050840 with isa=jenkins-hbase4.apache.org/172.31.14.131:36419, startcode=1676261050918 2023-02-13 04:04:11,152 DEBUG [RS:1;jenkins-hbase4:36419] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:04:11,154 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59971, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:04:11,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,156 DEBUG [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46 2023-02-13 04:04:11,156 DEBUG [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35745 2023-02-13 04:04:11,156 DEBUG [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:04:11,156 DEBUG [RS:0;jenkins-hbase4:41191] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41191 2023-02-13 04:04:11,156 INFO [RS:0;jenkins-hbase4:41191] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:04:11,156 INFO [RS:0;jenkins-hbase4:41191] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:04:11,156 DEBUG [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:04:11,157 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:11,158 INFO [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41243,1676261050840 with isa=jenkins-hbase4.apache.org/172.31.14.131:41191, startcode=1676261050890 2023-02-13 04:04:11,158 DEBUG [RS:0;jenkins-hbase4:41191] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:04:11,158 DEBUG [RS:1;jenkins-hbase4:36419] zookeeper.ZKUtil(162): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,158 WARN [RS:1;jenkins-hbase4:36419] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:04:11,158 INFO [RS:1;jenkins-hbase4:36419] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:11,158 DEBUG [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/WALs/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,160 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36419,1676261050918] 2023-02-13 04:04:11,160 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33453, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:04:11,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:11,161 DEBUG [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46 2023-02-13 04:04:11,161 DEBUG [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35745 2023-02-13 04:04:11,161 DEBUG [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:04:11,162 DEBUG [RS:1;jenkins-hbase4:36419] zookeeper.ZKUtil(162): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,166 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:11,166 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:11,166 DEBUG [RS:0;jenkins-hbase4:41191] zookeeper.ZKUtil(162): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:11,166 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41191,1676261050890] 2023-02-13 04:04:11,166 WARN [RS:0;jenkins-hbase4:41191] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:04:11,166 DEBUG [RS:1;jenkins-hbase4:36419] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:04:11,166 INFO [RS:0;jenkins-hbase4:41191] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:11,166 DEBUG [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/WALs/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:11,166 INFO [RS:1;jenkins-hbase4:36419] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:04:11,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:11,169 INFO [RS:1;jenkins-hbase4:36419] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:04:11,169 DEBUG [RS:0;jenkins-hbase4:41191] zookeeper.ZKUtil(162): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,170 DEBUG [RS:0;jenkins-hbase4:41191] zookeeper.ZKUtil(162): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:11,170 DEBUG [RS:0;jenkins-hbase4:41191] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:04:11,171 INFO [RS:0;jenkins-hbase4:41191] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:04:11,171 INFO [RS:1;jenkins-hbase4:36419] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:04:11,171 INFO [RS:1;jenkins-hbase4:36419] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,171 INFO [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:04:11,172 INFO [RS:0;jenkins-hbase4:41191] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:04:11,176 INFO [RS:1;jenkins-hbase4:36419] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,176 INFO [RS:0;jenkins-hbase4:41191] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:04:11,176 INFO [RS:0;jenkins-hbase4:41191] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,176 DEBUG [RS:1;jenkins-hbase4:36419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,176 DEBUG [RS:1;jenkins-hbase4:36419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,176 DEBUG [RS:1;jenkins-hbase4:36419] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,176 INFO [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:04:11,176 DEBUG [RS:1;jenkins-hbase4:36419] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,176 DEBUG [RS:1;jenkins-hbase4:36419] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,177 DEBUG [RS:1;jenkins-hbase4:36419] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:04:11,177 DEBUG [RS:1;jenkins-hbase4:36419] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,177 DEBUG [RS:1;jenkins-hbase4:36419] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,177 DEBUG [RS:1;jenkins-hbase4:36419] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,177 DEBUG [RS:1;jenkins-hbase4:36419] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,179 INFO [RS:1;jenkins-hbase4:36419] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,179 INFO [RS:0;jenkins-hbase4:41191] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,179 INFO [RS:1;jenkins-hbase4:36419] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,180 INFO [RS:1;jenkins-hbase4:36419] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,180 DEBUG [RS:0;jenkins-hbase4:41191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,180 DEBUG [RS:0;jenkins-hbase4:41191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,180 DEBUG [RS:0;jenkins-hbase4:41191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,180 DEBUG [RS:0;jenkins-hbase4:41191] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,180 DEBUG [RS:0;jenkins-hbase4:41191] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,180 DEBUG [RS:0;jenkins-hbase4:41191] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:04:11,180 DEBUG [RS:0;jenkins-hbase4:41191] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,180 DEBUG [RS:0;jenkins-hbase4:41191] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,180 DEBUG [RS:0;jenkins-hbase4:41191] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,180 DEBUG [RS:0;jenkins-hbase4:41191] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:11,182 INFO [RS:0;jenkins-hbase4:41191] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,182 INFO [RS:0;jenkins-hbase4:41191] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,182 INFO [RS:0;jenkins-hbase4:41191] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,190 INFO [RS:1;jenkins-hbase4:36419] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:04:11,191 INFO [RS:1;jenkins-hbase4:36419] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36419,1676261050918-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,192 INFO [RS:0;jenkins-hbase4:41191] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:04:11,192 INFO [RS:0;jenkins-hbase4:41191] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41191,1676261050890-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,202 INFO [RS:1;jenkins-hbase4:36419] regionserver.Replication(203): jenkins-hbase4.apache.org,36419,1676261050918 started 2023-02-13 04:04:11,202 INFO [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36419,1676261050918, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36419, sessionid=0x1004bd9b3890002 2023-02-13 04:04:11,202 DEBUG [RS:1;jenkins-hbase4:36419] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:04:11,202 DEBUG [RS:1;jenkins-hbase4:36419] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,202 DEBUG [RS:1;jenkins-hbase4:36419] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36419,1676261050918' 2023-02-13 04:04:11,202 DEBUG [RS:1;jenkins-hbase4:36419] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:11,202 DEBUG [RS:1;jenkins-hbase4:36419] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:11,203 DEBUG [RS:1;jenkins-hbase4:36419] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:04:11,203 DEBUG [RS:1;jenkins-hbase4:36419] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:04:11,203 DEBUG [RS:1;jenkins-hbase4:36419] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,203 INFO [RS:0;jenkins-hbase4:41191] regionserver.Replication(203): jenkins-hbase4.apache.org,41191,1676261050890 started 2023-02-13 04:04:11,203 DEBUG [RS:1;jenkins-hbase4:36419] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36419,1676261050918' 2023-02-13 04:04:11,203 DEBUG [RS:1;jenkins-hbase4:36419] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:11,203 INFO [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41191,1676261050890, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41191, sessionid=0x1004bd9b3890001 2023-02-13 04:04:11,203 DEBUG [RS:0;jenkins-hbase4:41191] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:04:11,203 DEBUG [RS:0;jenkins-hbase4:41191] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:11,203 DEBUG [RS:0;jenkins-hbase4:41191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41191,1676261050890' 2023-02-13 04:04:11,203 DEBUG [RS:0;jenkins-hbase4:41191] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:11,203 DEBUG [RS:1;jenkins-hbase4:36419] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:11,203 DEBUG [RS:0;jenkins-hbase4:41191] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:11,203 DEBUG [RS:1;jenkins-hbase4:36419] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:04:11,204 INFO [RS:1;jenkins-hbase4:36419] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:04:11,204 INFO [RS:1;jenkins-hbase4:36419] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:04:11,204 DEBUG [RS:0;jenkins-hbase4:41191] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:04:11,204 DEBUG [RS:0;jenkins-hbase4:41191] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:04:11,204 DEBUG [RS:0;jenkins-hbase4:41191] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:11,204 DEBUG [RS:0;jenkins-hbase4:41191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41191,1676261050890' 2023-02-13 04:04:11,204 DEBUG [RS:0;jenkins-hbase4:41191] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:11,204 DEBUG [RS:0;jenkins-hbase4:41191] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:11,204 DEBUG [RS:0;jenkins-hbase4:41191] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:04:11,204 INFO [RS:0;jenkins-hbase4:41191] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:04:11,204 INFO [RS:0;jenkins-hbase4:41191] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:04:11,241 DEBUG [jenkins-hbase4:41243] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 04:04:11,241 DEBUG [jenkins-hbase4:41243] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:04:11,242 DEBUG [jenkins-hbase4:41243] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:04:11,243 DEBUG [jenkins-hbase4:41243] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:04:11,243 DEBUG [jenkins-hbase4:41243] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:04:11,243 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41191,1676261050890, state=OPENING 2023-02-13 04:04:11,245 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 04:04:11,246 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:11,246 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:04:11,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41191,1676261050890}] 2023-02-13 04:04:11,401 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:11,401 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:04:11,403 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49370, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:04:11,407 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 04:04:11,407 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:11,408 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41191%2C1676261050890.meta, suffix=.meta, logDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/WALs/jenkins-hbase4.apache.org,41191,1676261050890, archiveDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/oldWALs, maxLogs=32 2023-02-13 04:04:11,421 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34353,DS-6e97dc3a-cc6b-4cc9-ba69-39993bff670f,DISK] 2023-02-13 04:04:11,421 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36485,DS-83d99dfa-6b34-413c-b0a5-869fa7a2590d,DISK] 2023-02-13 04:04:11,422 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/WALs/jenkins-hbase4.apache.org,41191,1676261050890/jenkins-hbase4.apache.org%2C41191%2C1676261050890.meta.1676261051408.meta 2023-02-13 04:04:11,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34353,DS-6e97dc3a-cc6b-4cc9-ba69-39993bff670f,DISK], DatanodeInfoWithStorage[127.0.0.1:36485,DS-83d99dfa-6b34-413c-b0a5-869fa7a2590d,DISK]] 2023-02-13 04:04:11,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:11,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 04:04:11,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 04:04:11,423 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 04:04:11,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 04:04:11,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:11,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 04:04:11,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 04:04:11,424 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:04:11,425 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/info 2023-02-13 04:04:11,425 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/info 2023-02-13 04:04:11,426 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:04:11,426 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:11,426 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:04:11,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:04:11,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:04:11,427 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:04:11,428 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:11,428 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:04:11,429 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/table 2023-02-13 04:04:11,429 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/table 2023-02-13 04:04:11,429 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:04:11,429 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:11,430 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740 2023-02-13 04:04:11,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740 2023-02-13 04:04:11,432 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:04:11,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:04:11,434 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61052898, jitterRate=-0.09024092555046082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:04:11,434 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676261051423Writing region info on filesystem at 1676261051423Initializing all the Stores at 1676261051424 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261051424Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261051424Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261051424Cleaning up temporary data from old regions at 1676261051431 (+7 ms)Cleaning up detritus from prior splits at 1676261051432 (+1 ms)Running coprocessor post-open hooks at 1676261051434 (+2 ms)Region opened successfully at 1676261051434 2023-02-13 04:04:11,434 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676261051401 2023-02-13 04:04:11,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 04:04:11,441 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 04:04:11,441 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41191,1676261050890, state=OPEN 2023-02-13 04:04:11,442 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 04:04:11,442 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:04:11,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 04:04:11,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41191,1676261050890 in 196 msec 2023-02-13 04:04:11,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 04:04:11,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-13 04:04:11,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 392 msec 2023-02-13 04:04:11,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676261050936, completionTime=-1 2023-02-13 04:04:11,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 04:04:11,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 04:04:11,447 DEBUG [hconnection-0x5d1860b4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:11,449 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49372, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:11,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 04:04:11,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676261111450 2023-02-13 04:04:11,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676261171450 2023-02-13 04:04:11,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-13 04:04:11,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41243,1676261050840-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41243,1676261050840-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41243,1676261050840-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41243, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:11,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 04:04:11,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:11,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 04:04:11,464 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 04:04:11,465 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:04:11,465 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:04:11,466 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:11,467 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da empty. 2023-02-13 04:04:11,467 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:11,467 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 04:04:11,475 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:11,476 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 68037fe58c6306b9fd9dd32921ae84da, NAME => 'hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp 2023-02-13 04:04:11,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:11,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 68037fe58c6306b9fd9dd32921ae84da, disabling compactions & flushes 2023-02-13 04:04:11,482 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:11,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:11,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. after waiting 0 ms 2023-02-13 04:04:11,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:11,482 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:11,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 68037fe58c6306b9fd9dd32921ae84da: Waiting for close lock at 1676261051482Disabling compacts and flushes for region at 1676261051482Disabling writes for close at 1676261051482Writing region close event to WAL at 1676261051482Closed at 1676261051482 2023-02-13 04:04:11,484 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:04:11,485 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261051485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261051485"}]},"ts":"1676261051485"} 2023-02-13 04:04:11,486 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:04:11,487 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:04:11,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261051487"}]},"ts":"1676261051487"} 2023-02-13 04:04:11,488 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 04:04:11,491 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:04:11,491 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:04:11,492 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:04:11,492 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:04:11,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=68037fe58c6306b9fd9dd32921ae84da, ASSIGN}] 2023-02-13 04:04:11,494 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=68037fe58c6306b9fd9dd32921ae84da, ASSIGN 2023-02-13 04:04:11,495 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=68037fe58c6306b9fd9dd32921ae84da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36419,1676261050918; forceNewPlan=false, retain=false 2023-02-13 04:04:11,645 INFO [jenkins-hbase4:41243] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:04:11,645 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=68037fe58c6306b9fd9dd32921ae84da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,645 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261051645"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261051645"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261051645"}]},"ts":"1676261051645"} 2023-02-13 04:04:11,648 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 68037fe58c6306b9fd9dd32921ae84da, server=jenkins-hbase4.apache.org,36419,1676261050918}] 2023-02-13 04:04:11,800 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,801 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:04:11,802 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56776, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:04:11,805 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:11,806 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36419%2C1676261050918, suffix=, logDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/WALs/jenkins-hbase4.apache.org,36419,1676261050918, archiveDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/oldWALs, maxLogs=32 2023-02-13 04:04:11,819 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34353,DS-6e97dc3a-cc6b-4cc9-ba69-39993bff670f,DISK] 2023-02-13 04:04:11,820 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36485,DS-83d99dfa-6b34-413c-b0a5-869fa7a2590d,DISK] 2023-02-13 04:04:11,821 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/WALs/jenkins-hbase4.apache.org,36419,1676261050918/jenkins-hbase4.apache.org%2C36419%2C1676261050918.1676261051807 2023-02-13 04:04:11,821 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34353,DS-6e97dc3a-cc6b-4cc9-ba69-39993bff670f,DISK], DatanodeInfoWithStorage[127.0.0.1:36485,DS-83d99dfa-6b34-413c-b0a5-869fa7a2590d,DISK]] 2023-02-13 04:04:11,821 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 68037fe58c6306b9fd9dd32921ae84da, NAME => 'hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:11,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:11,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:11,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:11,824 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:11,825 INFO [StoreOpener-68037fe58c6306b9fd9dd32921ae84da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:11,826 DEBUG [StoreOpener-68037fe58c6306b9fd9dd32921ae84da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da/info 2023-02-13 04:04:11,826 DEBUG [StoreOpener-68037fe58c6306b9fd9dd32921ae84da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da/info 2023-02-13 04:04:11,826 INFO [StoreOpener-68037fe58c6306b9fd9dd32921ae84da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68037fe58c6306b9fd9dd32921ae84da columnFamilyName info 2023-02-13 04:04:11,827 INFO [StoreOpener-68037fe58c6306b9fd9dd32921ae84da-1] regionserver.HStore(310): Store=68037fe58c6306b9fd9dd32921ae84da/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:11,827 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:11,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:11,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:11,831 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:11,831 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 68037fe58c6306b9fd9dd32921ae84da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70583088, jitterRate=0.05176997184753418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:04:11,831 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 68037fe58c6306b9fd9dd32921ae84da: Running coprocessor pre-open hook at 1676261051824Writing region info on filesystem at 1676261051824Initializing all the Stores at 1676261051825 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261051825Cleaning up temporary data from old regions at 1676261051828 (+3 ms)Cleaning up detritus from prior splits at 1676261051828Running coprocessor post-open hooks at 1676261051831 (+3 ms)Region opened successfully at 1676261051831 2023-02-13 04:04:11,832 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da., pid=6, masterSystemTime=1676261051800 2023-02-13 04:04:11,833 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:11,834 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:11,834 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=68037fe58c6306b9fd9dd32921ae84da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:11,834 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261051834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261051834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261051834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261051834"}]},"ts":"1676261051834"} 2023-02-13 04:04:11,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 04:04:11,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 68037fe58c6306b9fd9dd32921ae84da, server=jenkins-hbase4.apache.org,36419,1676261050918 in 188 msec 2023-02-13 04:04:11,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 04:04:11,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=68037fe58c6306b9fd9dd32921ae84da, ASSIGN in 345 msec 2023-02-13 04:04:11,838 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:04:11,839 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261051839"}]},"ts":"1676261051839"} 2023-02-13 04:04:11,840 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 04:04:11,842 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:04:11,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 379 msec 2023-02-13 04:04:11,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 04:04:11,866 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:04:11,866 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:11,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:11,869 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56778, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:11,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 04:04:11,876 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:04:11,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-13 04:04:11,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 04:04:11,887 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:04:11,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-13 04:04:11,895 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 04:04:11,897 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 04:04:11,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.957sec 2023-02-13 04:04:11,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 04:04:11,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 04:04:11,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 04:04:11,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41243,1676261050840-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 04:04:11,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41243,1676261050840-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 04:04:11,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 04:04:11,934 DEBUG [Listener at localhost/41441] zookeeper.ReadOnlyZKClient(139): Connect 0x2cae895e to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:11,937 DEBUG [Listener at localhost/41441] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8e7ea2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:11,938 DEBUG [hconnection-0x69e1d3b8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:11,940 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49376, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:11,941 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41243,1676261050840 2023-02-13 04:04:11,941 DEBUG [Listener at localhost/41441] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 04:04:11,943 DEBUG [Listener at localhost/41441] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:04:11,945 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56078, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:04:11,945 INFO [Listener at localhost/41441] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:11,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:11,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 04:04:11,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:56078 deadline: 1676261111945, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:11,946 INFO [Listener at localhost/41441] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 04:04:11,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:11,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:11,950 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:04:11,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-13 04:04:11,951 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:04:11,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:11,952 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:11,952 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e empty. 2023-02-13 04:04:11,953 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:11,953 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-13 04:04:11,962 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:11,963 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => ad27447fbbde7b41150545bd5105ff8e, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp 2023-02-13 04:04:11,969 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:11,969 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing ad27447fbbde7b41150545bd5105ff8e, disabling compactions & flushes 2023-02-13 04:04:11,969 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:11,969 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:11,969 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. after waiting 0 ms 2023-02-13 04:04:11,969 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:11,969 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:11,969 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for ad27447fbbde7b41150545bd5105ff8e: Waiting for close lock at 1676261051969Disabling compacts and flushes for region at 1676261051969Disabling writes for close at 1676261051969Writing region close event to WAL at 1676261051969Closed at 1676261051969 2023-02-13 04:04:11,971 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:04:11,972 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676261051972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261051972"}]},"ts":"1676261051972"} 2023-02-13 04:04:11,973 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:04:11,973 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:04:11,974 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261051974"}]},"ts":"1676261051974"} 2023-02-13 04:04:11,975 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-13 04:04:11,977 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:04:11,978 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:04:11,978 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:04:11,978 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:04:11,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ad27447fbbde7b41150545bd5105ff8e, ASSIGN}] 2023-02-13 04:04:11,980 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ad27447fbbde7b41150545bd5105ff8e, ASSIGN 2023-02-13 04:04:11,980 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ad27447fbbde7b41150545bd5105ff8e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41191,1676261050890; forceNewPlan=false, retain=false 2023-02-13 04:04:12,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:12,130 INFO [jenkins-hbase4:41243] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:04:12,131 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ad27447fbbde7b41150545bd5105ff8e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,131 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676261052131"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261052131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261052131"}]},"ts":"1676261052131"} 2023-02-13 04:04:12,132 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure ad27447fbbde7b41150545bd5105ff8e, server=jenkins-hbase4.apache.org,41191,1676261050890}] 2023-02-13 04:04:12,207 INFO [RS:0;jenkins-hbase4:41191] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41191%2C1676261050890, suffix=, logDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/WALs/jenkins-hbase4.apache.org,41191,1676261050890, archiveDir=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/oldWALs, maxLogs=32 2023-02-13 04:04:12,219 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36485,DS-83d99dfa-6b34-413c-b0a5-869fa7a2590d,DISK] 2023-02-13 04:04:12,219 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34353,DS-6e97dc3a-cc6b-4cc9-ba69-39993bff670f,DISK] 2023-02-13 04:04:12,221 INFO [RS:0;jenkins-hbase4:41191] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/WALs/jenkins-hbase4.apache.org,41191,1676261050890/jenkins-hbase4.apache.org%2C41191%2C1676261050890.1676261052207 2023-02-13 04:04:12,223 DEBUG [RS:0;jenkins-hbase4:41191] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36485,DS-83d99dfa-6b34-413c-b0a5-869fa7a2590d,DISK], DatanodeInfoWithStorage[127.0.0.1:34353,DS-6e97dc3a-cc6b-4cc9-ba69-39993bff670f,DISK]] 2023-02-13 04:04:12,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:12,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:12,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ad27447fbbde7b41150545bd5105ff8e, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:12,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:12,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:12,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:12,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:12,288 INFO [StoreOpener-ad27447fbbde7b41150545bd5105ff8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:12,289 DEBUG [StoreOpener-ad27447fbbde7b41150545bd5105ff8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1 2023-02-13 04:04:12,289 DEBUG [StoreOpener-ad27447fbbde7b41150545bd5105ff8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1 2023-02-13 04:04:12,289 INFO [StoreOpener-ad27447fbbde7b41150545bd5105ff8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad27447fbbde7b41150545bd5105ff8e columnFamilyName f1 2023-02-13 04:04:12,290 INFO [StoreOpener-ad27447fbbde7b41150545bd5105ff8e-1] regionserver.HStore(310): Store=ad27447fbbde7b41150545bd5105ff8e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:12,290 INFO [StoreOpener-ad27447fbbde7b41150545bd5105ff8e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:12,291 DEBUG [StoreOpener-ad27447fbbde7b41150545bd5105ff8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2 2023-02-13 04:04:12,291 DEBUG [StoreOpener-ad27447fbbde7b41150545bd5105ff8e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2 2023-02-13 04:04:12,291 INFO [StoreOpener-ad27447fbbde7b41150545bd5105ff8e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad27447fbbde7b41150545bd5105ff8e columnFamilyName f2 2023-02-13 04:04:12,291 INFO [StoreOpener-ad27447fbbde7b41150545bd5105ff8e-1] regionserver.HStore(310): Store=ad27447fbbde7b41150545bd5105ff8e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:12,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:12,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:12,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:12,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:12,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:12,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ad27447fbbde7b41150545bd5105ff8e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66277905, jitterRate=-0.012382254004478455}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:12,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ad27447fbbde7b41150545bd5105ff8e: Running coprocessor pre-open hook at 1676261052287Writing region info on filesystem at 1676261052287Initializing all the Stores at 1676261052288 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261052288Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261052288Cleaning up temporary data from old regions at 1676261052293 (+5 ms)Cleaning up detritus from prior splits at 1676261052293Running coprocessor post-open hooks at 1676261052296 (+3 ms)Region opened successfully at 1676261052296 2023-02-13 04:04:12,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e., pid=12, masterSystemTime=1676261052284 2023-02-13 04:04:12,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:12,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:12,298 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=ad27447fbbde7b41150545bd5105ff8e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,298 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676261052298"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261052298"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261052298"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261052298"}]},"ts":"1676261052298"} 2023-02-13 04:04:12,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 04:04:12,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure ad27447fbbde7b41150545bd5105ff8e, server=jenkins-hbase4.apache.org,41191,1676261050890 in 167 msec 2023-02-13 04:04:12,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 04:04:12,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ad27447fbbde7b41150545bd5105ff8e, ASSIGN in 322 msec 2023-02-13 04:04:12,302 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:04:12,302 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261052302"}]},"ts":"1676261052302"} 2023-02-13 04:04:12,303 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-13 04:04:12,307 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:04:12,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 359 msec 2023-02-13 04:04:12,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:12,555 INFO [Listener at localhost/41441] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-13 04:04:12,556 DEBUG [Listener at localhost/41441] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-13 04:04:12,556 INFO [Listener at localhost/41441] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:04:12,558 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-13 04:04:12,558 INFO [Listener at localhost/41441] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:04:12,558 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-13 04:04:12,558 INFO [Listener at localhost/41441] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 04:04:12,586 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41191] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:12,670 INFO [Listener at localhost/41441] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 04:04:12,670 INFO [Listener at localhost/41441] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 04:04:12,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 04:04:12,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676261052671 (current time:1676261052671). 2023-02-13 04:04:12,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 04:04:12,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] zookeeper.ReadOnlyZKClient(139): Connect 0x4f3dd053 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:12,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e5b07ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:12,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:12,677 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49388, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:12,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f3dd053 to 127.0.0.1:60098 2023-02-13 04:04:12,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:12,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 04:04:12,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 04:04:12,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 04:04:12,681 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 04:04:12,682 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676261652682 2023-02-13 04:04:12,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 04:04:12,682 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:12,683 DEBUG [Listener at localhost/41441] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 04:04:12,684 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 04:04:12,684 DEBUG [Listener at localhost/41441] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 04:04:12,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 04:04:12,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-13 04:04:12,686 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 04:04:12,686 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676261652686 2023-02-13 04:04:12,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-13 04:04:12,695 INFO [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-13 04:04:12,695 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:04:12,695 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-13 04:04:12,695 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-13 04:04:12,696 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,696 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-13 04:04:12,697 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:12,697 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:12,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:12,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:12,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:12,697 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:12,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 04:04:12,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 04:04:12,697 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,698 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:04:12,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 04:04:12,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 04:04:12,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 04:04:12,698 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-13 04:04:12,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 04:04:12,698 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-13 04:04:12,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 04:04:12,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 04:04:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 04:04:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:04:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 04:04:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 04:04:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 04:04:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:04:12,699 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36419,1676261050918' joining acquired barrier for procedure (foo) in zk 2023-02-13 04:04:12,700 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 04:04:12,700 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 04:04:12,700 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41191,1676261050890' joining acquired barrier for procedure (foo) in zk 2023-02-13 04:04:12,703 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,703 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,703 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:12,703 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,703 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:12,704 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,704 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:04:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:12,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:12,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41191,1676261050890' joining acquired barrier for procedure 'foo' on coordinator 2023-02-13 04:04:12,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b0aa0d6[Count = 0] remaining members to acquire global barrier 2023-02-13 04:04:12,705 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-13 04:04:12,705 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,706 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,706 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,706 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 04:04:12,706 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 04:04:12,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,706 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,36419,1676261050918' in zk 2023-02-13 04:04:12,706 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 04:04:12,706 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,706 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:04:12,706 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 04:04:12,706 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:04:12,707 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:12,707 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. started... 2023-02-13 04:04:12,707 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ad27447fbbde7b41150545bd5105ff8e 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 04:04:12,708 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 04:04:12,708 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:12,708 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 04:04:12,726 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/.tmp/f1/962596ec82d14d0c88715a4f818a97a0 2023-02-13 04:04:12,743 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/.tmp/f2/6651a799391c4121a640710672d59ed6 2023-02-13 04:04:12,747 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/.tmp/f1/962596ec82d14d0c88715a4f818a97a0 as hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/962596ec82d14d0c88715a4f818a97a0 2023-02-13 04:04:12,751 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/962596ec82d14d0c88715a4f818a97a0, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 04:04:12,751 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/.tmp/f2/6651a799391c4121a640710672d59ed6 as hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/6651a799391c4121a640710672d59ed6 2023-02-13 04:04:12,755 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/6651a799391c4121a640710672d59ed6, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 04:04:12,756 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for ad27447fbbde7b41150545bd5105ff8e in 49ms, sequenceid=5, compaction requested=false 2023-02-13 04:04:12,756 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 04:04:12,756 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ad27447fbbde7b41150545bd5105ff8e: 2023-02-13 04:04:12,756 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.' region-info for snapshot=foo 2023-02-13 04:04:12,756 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:04:12,756 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/962596ec82d14d0c88715a4f818a97a0] hfiles 2023-02-13 04:04:12,756 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/962596ec82d14d0c88715a4f818a97a0 for snapshot=foo 2023-02-13 04:04:12,757 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/6651a799391c4121a640710672d59ed6] hfiles 2023-02-13 04:04:12,757 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/6651a799391c4121a640710672d59ed6 for snapshot=foo 2023-02-13 04:04:12,763 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. completed. 2023-02-13 04:04:12,764 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:12,764 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 04:04:12,764 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 04:04:12,764 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,764 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 04:04:12,764 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41191,1676261050890' in zk 2023-02-13 04:04:12,766 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 04:04:12,766 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,766 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:12,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:12,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:12,766 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 04:04:12,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:12,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:12,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:04:12,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:12,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:12,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:04:12,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:12,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,41191,1676261050890': 2023-02-13 04:04:12,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41191,1676261050890' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-13 04:04:12,769 INFO [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-13 04:04:12,769 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:04:12,769 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:04:12,769 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-13 04:04:12,769 INFO [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 04:04:12,771 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,771 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:12,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:12,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,771 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:12,771 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,771 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:12,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:12,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:12,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:12,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:12,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:12,772 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:12,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:04:12,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,772 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:12,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:04:12,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:12,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:12,773 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:12,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 04:04:12,774 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:12,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,778 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,778 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:12,778 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 04:04:12,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:12,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-13 04:04:12,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:12,778 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:12,778 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:12,778 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:12,778 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:12,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:12,778 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:12,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:12,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:12,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-13 04:04:12,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:12,778 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 04:04:12,778 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:12,779 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,779 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:12,779 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 04:04:12,779 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 04:04:12,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:12,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:12,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.hbase-snapshot/.tmp/foo 2023-02-13 04:04:12,784 DEBUG [Listener at localhost/41441] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:04:12,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 04:04:12,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:04:12,785 DEBUG [Listener at localhost/41441] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 04:04:12,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.hbase-snapshot/.tmp/foo to hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.hbase-snapshot/foo 2023-02-13 04:04:12,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-13 04:04:12,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.hbase-snapshot/.tmp/foo 2023-02-13 04:04:12,809 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.hbase-snapshot/.tmp/foo 2023-02-13 04:04:12,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676261052682Consolidate snapshot: foo at 1676261052778 (+96 ms)Loading Region manifests for foo at 1676261052778Writing data manifest for foo at 1676261052782 (+4 ms)Verifying snapshot: foo at 1676261052790 (+8 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676261052809 (+19 ms) 2023-02-13 04:04:12,811 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 04:04:12,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 128 msec 2023-02-13 04:04:12,986 DEBUG [Listener at localhost/41441] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:04:12,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 04:04:12,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 04:04:12,987 INFO [Listener at localhost/41441] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 04:04:12,990 INFO [Listener at localhost/41441] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 04:04:12,994 INFO [Listener at localhost/41441] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 04:04:13,021 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41191] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,104 INFO [Listener at localhost/41441] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 04:04:13,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:04:13,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,111 INFO [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 04:04:13,111 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:13,111 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-13 04:04:13,111 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-13 04:04:13,112 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,112 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,114 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:13,114 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:13,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:13,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:13,114 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,115 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,115 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:04:13,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:04:13,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:04:13,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,115 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,115 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,116 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-13 04:04:13,116 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:13,116 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-13 04:04:13,116 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-13 04:04:13,116 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-13 04:04:13,117 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36419,1676261050918' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-13 04:04:13,116 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:13,117 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-13 04:04:13,117 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:04:13,117 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:04:13,117 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,117 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. started... 2023-02-13 04:04:13,118 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ad27447fbbde7b41150545bd5105ff8e 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 04:04:13,118 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,119 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,119 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:13,131 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/.tmp/f1/47fb8a28f4d1496990629ca31f87a84e 2023-02-13 04:04:13,150 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/.tmp/f2/dac395dfe5914750ae21cc0c8e0ed11f 2023-02-13 04:04:13,154 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/.tmp/f1/47fb8a28f4d1496990629ca31f87a84e as hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/47fb8a28f4d1496990629ca31f87a84e 2023-02-13 04:04:13,157 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/47fb8a28f4d1496990629ca31f87a84e, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 04:04:13,158 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/.tmp/f2/dac395dfe5914750ae21cc0c8e0ed11f as hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/dac395dfe5914750ae21cc0c8e0ed11f 2023-02-13 04:04:13,161 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/dac395dfe5914750ae21cc0c8e0ed11f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 04:04:13,162 INFO [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for ad27447fbbde7b41150545bd5105ff8e in 45ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:13,163 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ad27447fbbde7b41150545bd5105ff8e: 2023-02-13 04:04:13,163 DEBUG [rs(jenkins-hbase4.apache.org,41191,1676261050890)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,163 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:04:13,163 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:04:13,163 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,163 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-13 04:04:13,164 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41191,1676261050890' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-13 04:04:13,165 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,165 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:13,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:13,165 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,165 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:13,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:13,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:13,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:13,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41191,1676261050890' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-13 04:04:13,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f35336f[Count = 0] remaining members to acquire global barrier 2023-02-13 04:04:13,167 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-13 04:04:13,167 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,168 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,168 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,168 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-13 04:04:13,169 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,169 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:04:13,169 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-13 04:04:13,169 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-13 04:04:13,169 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-13 04:04:13,169 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,36419,1676261050918' in zk 2023-02-13 04:04:13,169 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,41191,1676261050890' in zk 2023-02-13 04:04:13,171 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-13 04:04:13,171 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,171 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-13 04:04:13,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:13,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:13,171 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:13,171 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:13,171 DEBUG [member: 'jenkins-hbase4.apache.org,41191,1676261050890' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-13 04:04:13,171 DEBUG [member: 'jenkins-hbase4.apache.org,36419,1676261050918' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-13 04:04:13,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:13,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:13,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:13,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,41191,1676261050890': 2023-02-13 04:04:13,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41191,1676261050890' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-13 04:04:13,174 INFO [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-13 04:04:13,174 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:04:13,174 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:04:13,174 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,174 INFO [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:04:13,176 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,176 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:13,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,176 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:13,176 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,176 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:13,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:13,176 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:13,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:13,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,177 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:13,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,183 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:13,183 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,185 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:13,185 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:13,185 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:13,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:13,185 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:13,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:13,186 DEBUG [(jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:13,185 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 04:04:13,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:04:13,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:13,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:13,186 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,186 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,186 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,186 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,186 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,186 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:13,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:13,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:13,186 DEBUG [Listener at localhost/41441] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-13 04:04:13,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:13,186 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,186 DEBUG [Listener at localhost/41441] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:04:13,187 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,287 DEBUG [Listener at localhost/41441] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:04:13,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:04:13,292 INFO [Listener at localhost/41441] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676261052671 type: FLUSH version: 2 ttl: 0 2023-02-13 04:04:13,292 DEBUG [Listener at localhost/41441] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35745/user/jenkins/test-data/5b444e10-7105-31a0-cd74-fcc7a00d3b3d/foo/c6c38376-772c-4fa9-b95c-3b5c8a1ea2dd/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,292 INFO [Listener at localhost/41441] snapshot.RestoreSnapshotHelper(239): region to add: ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:13,292 INFO [Listener at localhost/41441] snapshot.RestoreSnapshotHelper(585): clone region=ad27447fbbde7b41150545bd5105ff8e as ad27447fbbde7b41150545bd5105ff8e in snapshot foo 2023-02-13 04:04:13,293 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ad27447fbbde7b41150545bd5105ff8e, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35745/user/jenkins/test-data/5b444e10-7105-31a0-cd74-fcc7a00d3b3d/foo/c6c38376-772c-4fa9-b95c-3b5c8a1ea2dd 2023-02-13 04:04:13,301 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:13,301 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 962596ec82d14d0c88715a4f818a97a0 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,303 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6651a799391c4121a640710672d59ed6 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,304 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ad27447fbbde7b41150545bd5105ff8e, disabling compactions & flushes 2023-02-13 04:04:13,304 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,304 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,304 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. after waiting 0 ms 2023-02-13 04:04:13,304 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,304 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,304 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ad27447fbbde7b41150545bd5105ff8e: Waiting for close lock at 1676261053304Disabling compacts and flushes for region at 1676261053304Disabling writes for close at 1676261053304Writing region close event to WAL at 1676261053304Closed at 1676261053304 2023-02-13 04:04:13,306 INFO [Listener at localhost/41441] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676261052671 type: FLUSH version: 2 ttl: 0 2023-02-13 04:04:13,306 DEBUG [Listener at localhost/41441] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35745/user/jenkins/test-data/5b444e10-7105-31a0-cd74-fcc7a00d3b3d/foo/c6c38376-772c-4fa9-b95c-3b5c8a1ea2dd 2023-02-13 04:04:13,306 DEBUG [Listener at localhost/41441] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35745/user/jenkins/test-data/5b444e10-7105-31a0-cd74-fcc7a00d3b3d/foo/c6c38376-772c-4fa9-b95c-3b5c8a1ea2dd 2023-02-13 04:04:13,307 DEBUG [Listener at localhost/41441] util.CommonFSUtils(699): |-data/ 2023-02-13 04:04:13,307 DEBUG [Listener at localhost/41441] util.CommonFSUtils(699): |----default/ 2023-02-13 04:04:13,308 DEBUG [Listener at localhost/41441] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-13 04:04:13,308 DEBUG [Listener at localhost/41441] util.CommonFSUtils(699): |----------ad27447fbbde7b41150545bd5105ff8e/ 2023-02-13 04:04:13,308 DEBUG [Listener at localhost/41441] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:13,308 DEBUG [Listener at localhost/41441] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:13,309 DEBUG [Listener at localhost/41441] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=ad27447fbbde7b41150545bd5105ff8e-962596ec82d14d0c88715a4f818a97a0 2023-02-13 04:04:13,309 DEBUG [Listener at localhost/41441] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:13,309 DEBUG [Listener at localhost/41441] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=ad27447fbbde7b41150545bd5105ff8e-6651a799391c4121a640710672d59ed6 hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/47fb8a28f4d1496990629ca31f87a84e hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/962596ec82d14d0c88715a4f818a97a0 hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/6651a799391c4121a640710672d59ed6 hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/dac395dfe5914750ae21cc0c8e0ed11f 2023-02-13 04:04:13,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-13 04:04:13,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-13 04:04:13,317 INFO [Listener at localhost/41441] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261053321"}]},"ts":"1676261053321"} 2023-02-13 04:04:13,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:04:13,322 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-13 04:04:13,324 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-13 04:04:13,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ad27447fbbde7b41150545bd5105ff8e, UNASSIGN}] 2023-02-13 04:04:13,327 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ad27447fbbde7b41150545bd5105ff8e, UNASSIGN 2023-02-13 04:04:13,328 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ad27447fbbde7b41150545bd5105ff8e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,328 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676261053328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261053328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261053328"}]},"ts":"1676261053328"} 2023-02-13 04:04:13,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure ad27447fbbde7b41150545bd5105ff8e, server=jenkins-hbase4.apache.org,41191,1676261050890}] 2023-02-13 04:04:13,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:04:13,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:13,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ad27447fbbde7b41150545bd5105ff8e, disabling compactions & flushes 2023-02-13 04:04:13,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. after waiting 0 ms 2023-02-13 04:04:13,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:13,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e. 2023-02-13 04:04:13,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ad27447fbbde7b41150545bd5105ff8e: Waiting for close lock at 1676261053481Running coprocessor pre-close hooks at 1676261053481Disabling compacts and flushes for region at 1676261053481Disabling writes for close at 1676261053481Writing region close event to WAL at 1676261053482 (+1 ms)Running coprocessor post-close hooks at 1676261053485 (+3 ms)Closed at 1676261053485 2023-02-13 04:04:13,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:13,487 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ad27447fbbde7b41150545bd5105ff8e, regionState=CLOSED 2023-02-13 04:04:13,487 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676261053487"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261053487"}]},"ts":"1676261053487"} 2023-02-13 04:04:13,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 04:04:13,490 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure ad27447fbbde7b41150545bd5105ff8e, server=jenkins-hbase4.apache.org,41191,1676261050890 in 159 msec 2023-02-13 04:04:13,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 04:04:13,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=ad27447fbbde7b41150545bd5105ff8e, UNASSIGN in 166 msec 2023-02-13 04:04:13,491 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261053491"}]},"ts":"1676261053491"} 2023-02-13 04:04:13,492 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-13 04:04:13,500 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-13 04:04:13,502 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 183 msec 2023-02-13 04:04:13,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:04:13,625 INFO [Listener at localhost/41441] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-13 04:04:13,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,628 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,629 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 04:04:13,633 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:13,635 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1, FileablePath, hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2, FileablePath, hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/recovered.edits] 2023-02-13 04:04:13,640 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/47fb8a28f4d1496990629ca31f87a84e to hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/47fb8a28f4d1496990629ca31f87a84e 2023-02-13 04:04:13,641 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/962596ec82d14d0c88715a4f818a97a0 to hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f1/962596ec82d14d0c88715a4f818a97a0 2023-02-13 04:04:13,644 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/6651a799391c4121a640710672d59ed6 to hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/6651a799391c4121a640710672d59ed6 2023-02-13 04:04:13,645 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/dac395dfe5914750ae21cc0c8e0ed11f to hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/f2/dac395dfe5914750ae21cc0c8e0ed11f 2023-02-13 04:04:13,647 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/recovered.edits/12.seqid to hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e/recovered.edits/12.seqid 2023-02-13 04:04:13,648 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/ad27447fbbde7b41150545bd5105ff8e 2023-02-13 04:04:13,648 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-13 04:04:13,650 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,652 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-13 04:04:13,653 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-13 04:04:13,661 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,661 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-13 04:04:13,661 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261053661"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:13,663 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 04:04:13,663 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ad27447fbbde7b41150545bd5105ff8e, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676261051948.ad27447fbbde7b41150545bd5105ff8e.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 04:04:13,663 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-13 04:04:13,663 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676261053663"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:13,665 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-13 04:04:13,666 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 04:04:13,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 41 msec 2023-02-13 04:04:13,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41243] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 04:04:13,732 INFO [Listener at localhost/41441] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-13 04:04:13,732 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 04:04:13,732 INFO [Listener at localhost/41441] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:04:13,732 DEBUG [Listener at localhost/41441] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cae895e to 127.0.0.1:60098 2023-02-13 04:04:13,732 DEBUG [Listener at localhost/41441] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:13,732 DEBUG [Listener at localhost/41441] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 04:04:13,733 DEBUG [Listener at localhost/41441] util.JVMClusterUtil(257): Found active master hash=463789454, stopped=false 2023-02-13 04:04:13,733 INFO [Listener at localhost/41441] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41243,1676261050840 2023-02-13 04:04:13,734 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:13,734 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:13,734 INFO [Listener at localhost/41441] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 04:04:13,734 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:13,735 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:13,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:13,736 DEBUG [Listener at localhost/41441] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00b9cf17 to 127.0.0.1:60098 2023-02-13 04:04:13,736 DEBUG [Listener at localhost/41441] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:13,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:13,737 INFO [Listener at localhost/41441] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41191,1676261050890' ***** 2023-02-13 04:04:13,737 INFO [Listener at localhost/41441] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:04:13,737 INFO [Listener at localhost/41441] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36419,1676261050918' ***** 2023-02-13 04:04:13,737 INFO [Listener at localhost/41441] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:04:13,737 INFO [RS:0;jenkins-hbase4:41191] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:04:13,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:13,737 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:04:13,737 INFO [RS:1;jenkins-hbase4:36419] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:04:13,737 INFO [RS:1;jenkins-hbase4:36419] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:04:13,737 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:04:13,737 INFO [RS:0;jenkins-hbase4:41191] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:04:13,737 INFO [RS:1;jenkins-hbase4:36419] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:04:13,737 INFO [RS:0;jenkins-hbase4:41191] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:04:13,739 INFO [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(3304): Received CLOSE for 68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:13,739 INFO [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:13,739 DEBUG [RS:0;jenkins-hbase4:41191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e804415 to 127.0.0.1:60098 2023-02-13 04:04:13,739 DEBUG [RS:0;jenkins-hbase4:41191] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:13,739 INFO [RS:0;jenkins-hbase4:41191] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:04:13,739 INFO [RS:0;jenkins-hbase4:41191] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:04:13,739 INFO [RS:0;jenkins-hbase4:41191] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:04:13,739 INFO [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 04:04:13,739 INFO [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,739 DEBUG [RS:1;jenkins-hbase4:36419] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54cb8a50 to 127.0.0.1:60098 2023-02-13 04:04:13,739 INFO [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 04:04:13,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 68037fe58c6306b9fd9dd32921ae84da, disabling compactions & flushes 2023-02-13 04:04:13,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:13,739 DEBUG [RS:1;jenkins-hbase4:36419] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:13,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:13,739 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:04:13,739 DEBUG [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 04:04:13,739 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:04:13,740 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:04:13,740 DEBUG [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 04:04:13,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. after waiting 0 ms 2023-02-13 04:04:13,739 INFO [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 04:04:13,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:13,740 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:04:13,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 68037fe58c6306b9fd9dd32921ae84da 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 04:04:13,740 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:04:13,740 DEBUG [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1479): Online Regions={68037fe58c6306b9fd9dd32921ae84da=hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da.} 2023-02-13 04:04:13,740 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-13 04:04:13,740 DEBUG [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1505): Waiting on 68037fe58c6306b9fd9dd32921ae84da 2023-02-13 04:04:13,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da/.tmp/info/6fc3e77de8954d5c83983bee66931fe3 2023-02-13 04:04:13,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/.tmp/info/691e0ba9ee764ddbb16c4a8c82ae571a 2023-02-13 04:04:13,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da/.tmp/info/6fc3e77de8954d5c83983bee66931fe3 as hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da/info/6fc3e77de8954d5c83983bee66931fe3 2023-02-13 04:04:13,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 691e0ba9ee764ddbb16c4a8c82ae571a 2023-02-13 04:04:13,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da/info/6fc3e77de8954d5c83983bee66931fe3, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 04:04:13,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 68037fe58c6306b9fd9dd32921ae84da in 18ms, sequenceid=6, compaction requested=false 2023-02-13 04:04:13,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 04:04:13,762 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/.tmp/rep_barrier/deecaaf32e3142dda5a318029f639e54 2023-02-13 04:04:13,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/namespace/68037fe58c6306b9fd9dd32921ae84da/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 04:04:13,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:13,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 68037fe58c6306b9fd9dd32921ae84da: Waiting for close lock at 1676261053739Running coprocessor pre-close hooks at 1676261053739Disabling compacts and flushes for region at 1676261053739Disabling writes for close at 1676261053740 (+1 ms)Obtaining lock to block concurrent updates at 1676261053740Preparing flush snapshotting stores in 68037fe58c6306b9fd9dd32921ae84da at 1676261053740Finished memstore snapshotting hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676261053740Flushing stores of hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. at 1676261053741 (+1 ms)Flushing 68037fe58c6306b9fd9dd32921ae84da/info: creating writer at 1676261053741Flushing 68037fe58c6306b9fd9dd32921ae84da/info: appending metadata at 1676261053743 (+2 ms)Flushing 68037fe58c6306b9fd9dd32921ae84da/info: closing flushed file at 1676261053743Flushing 68037fe58c6306b9fd9dd32921ae84da/info: reopening flushed file at 1676261053754 (+11 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 68037fe58c6306b9fd9dd32921ae84da in 18ms, sequenceid=6, compaction requested=false at 1676261053758 (+4 ms)Writing region close event to WAL at 1676261053759 (+1 ms)Running coprocessor post-close hooks at 1676261053763 (+4 ms)Closed at 1676261053763 2023-02-13 04:04:13,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676261051463.68037fe58c6306b9fd9dd32921ae84da. 2023-02-13 04:04:13,765 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for deecaaf32e3142dda5a318029f639e54 2023-02-13 04:04:13,773 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/.tmp/table/41dd63cd093b467c8e8944bdd35b5374 2023-02-13 04:04:13,776 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41dd63cd093b467c8e8944bdd35b5374 2023-02-13 04:04:13,776 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/.tmp/info/691e0ba9ee764ddbb16c4a8c82ae571a as hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/info/691e0ba9ee764ddbb16c4a8c82ae571a 2023-02-13 04:04:13,780 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 691e0ba9ee764ddbb16c4a8c82ae571a 2023-02-13 04:04:13,780 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/info/691e0ba9ee764ddbb16c4a8c82ae571a, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 04:04:13,780 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/.tmp/rep_barrier/deecaaf32e3142dda5a318029f639e54 as hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/rep_barrier/deecaaf32e3142dda5a318029f639e54 2023-02-13 04:04:13,782 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:13,785 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:13,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for deecaaf32e3142dda5a318029f639e54 2023-02-13 04:04:13,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/rep_barrier/deecaaf32e3142dda5a318029f639e54, entries=1, sequenceid=21, filesize=5.1 K 2023-02-13 04:04:13,787 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/.tmp/table/41dd63cd093b467c8e8944bdd35b5374 as hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/table/41dd63cd093b467c8e8944bdd35b5374 2023-02-13 04:04:13,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41dd63cd093b467c8e8944bdd35b5374 2023-02-13 04:04:13,797 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/table/41dd63cd093b467c8e8944bdd35b5374, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 04:04:13,798 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 58ms, sequenceid=21, compaction requested=false 2023-02-13 04:04:13,798 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 04:04:13,802 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 04:04:13,803 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 04:04:13,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:13,803 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261053739Running coprocessor pre-close hooks at 1676261053739Disabling compacts and flushes for region at 1676261053739Disabling writes for close at 1676261053740 (+1 ms)Obtaining lock to block concurrent updates at 1676261053740Preparing flush snapshotting stores in 1588230740 at 1676261053740Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676261053740Flushing stores of hbase:meta,,1.1588230740 at 1676261053741 (+1 ms)Flushing 1588230740/info: creating writer at 1676261053741Flushing 1588230740/info: appending metadata at 1676261053743 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676261053743Flushing 1588230740/rep_barrier: creating writer at 1676261053754 (+11 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676261053756 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676261053756Flushing 1588230740/table: creating writer at 1676261053766 (+10 ms)Flushing 1588230740/table: appending metadata at 1676261053768 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676261053768Flushing 1588230740/info: reopening flushed file at 1676261053777 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676261053781 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676261053787 (+6 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 58ms, sequenceid=21, compaction requested=false at 1676261053798 (+11 ms)Writing region close event to WAL at 1676261053799 (+1 ms)Running coprocessor post-close hooks at 1676261053803 (+4 ms)Closed at 1676261053803 2023-02-13 04:04:13,803 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:13,940 INFO [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41191,1676261050890; all regions closed. 2023-02-13 04:04:13,940 INFO [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36419,1676261050918; all regions closed. 2023-02-13 04:04:13,944 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/WALs/jenkins-hbase4.apache.org,41191,1676261050890/jenkins-hbase4.apache.org%2C41191%2C1676261050890.meta.1676261051408.meta not finished, retry = 0 2023-02-13 04:04:13,946 DEBUG [RS:1;jenkins-hbase4:36419] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/oldWALs 2023-02-13 04:04:13,946 INFO [RS:1;jenkins-hbase4:36419] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36419%2C1676261050918:(num 1676261051807) 2023-02-13 04:04:13,946 DEBUG [RS:1;jenkins-hbase4:36419] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:13,946 INFO [RS:1;jenkins-hbase4:36419] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:13,947 INFO [RS:1;jenkins-hbase4:36419] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 04:04:13,947 INFO [RS:1;jenkins-hbase4:36419] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:04:13,947 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:13,947 INFO [RS:1;jenkins-hbase4:36419] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:04:13,947 INFO [RS:1;jenkins-hbase4:36419] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:04:13,948 INFO [RS:1;jenkins-hbase4:36419] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36419 2023-02-13 04:04:13,949 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,949 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36419,1676261050918 2023-02-13 04:04:13,950 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:13,950 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:13,950 ERROR [Listener at localhost/41441-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@575bc230 rejected from java.util.concurrent.ThreadPoolExecutor@53645c03[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:13,950 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:13,950 ERROR [Listener at localhost/41441-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ef9521b rejected from java.util.concurrent.ThreadPoolExecutor@53645c03[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:13,952 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36419,1676261050918] 2023-02-13 04:04:13,952 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36419,1676261050918; numProcessing=1 2023-02-13 04:04:13,953 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36419,1676261050918 already deleted, retry=false 2023-02-13 04:04:13,953 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36419,1676261050918 expired; onlineServers=1 2023-02-13 04:04:14,046 DEBUG [RS:0;jenkins-hbase4:41191] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/oldWALs 2023-02-13 04:04:14,046 INFO [RS:0;jenkins-hbase4:41191] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41191%2C1676261050890.meta:.meta(num 1676261051408) 2023-02-13 04:04:14,050 DEBUG [RS:0;jenkins-hbase4:41191] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/oldWALs 2023-02-13 04:04:14,050 INFO [RS:0;jenkins-hbase4:41191] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41191%2C1676261050890:(num 1676261052207) 2023-02-13 04:04:14,050 DEBUG [RS:0;jenkins-hbase4:41191] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:14,050 INFO [RS:0;jenkins-hbase4:41191] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:14,050 INFO [RS:0;jenkins-hbase4:41191] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 04:04:14,051 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:14,053 INFO [RS:0;jenkins-hbase4:41191] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41191 2023-02-13 04:04:14,054 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41191,1676261050890 2023-02-13 04:04:14,054 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:14,054 ERROR [Listener at localhost/41441-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30370bb1 rejected from java.util.concurrent.ThreadPoolExecutor@3408896f[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:14,055 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41191,1676261050890] 2023-02-13 04:04:14,055 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41191,1676261050890; numProcessing=2 2023-02-13 04:04:14,057 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41191,1676261050890 already deleted, retry=false 2023-02-13 04:04:14,057 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41191,1676261050890 expired; onlineServers=0 2023-02-13 04:04:14,057 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41243,1676261050840' ***** 2023-02-13 04:04:14,057 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 04:04:14,058 DEBUG [M:0;jenkins-hbase4:41243] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f9b5a22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:04:14,058 INFO [M:0;jenkins-hbase4:41243] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41243,1676261050840 2023-02-13 04:04:14,058 INFO [M:0;jenkins-hbase4:41243] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41243,1676261050840; all regions closed. 2023-02-13 04:04:14,058 DEBUG [M:0;jenkins-hbase4:41243] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:14,058 DEBUG [M:0;jenkins-hbase4:41243] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 04:04:14,058 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 04:04:14,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261051058] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261051058,5,FailOnTimeoutGroup] 2023-02-13 04:04:14,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261051060] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261051060,5,FailOnTimeoutGroup] 2023-02-13 04:04:14,058 DEBUG [M:0;jenkins-hbase4:41243] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 04:04:14,060 INFO [M:0;jenkins-hbase4:41243] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 04:04:14,060 INFO [M:0;jenkins-hbase4:41243] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 04:04:14,060 INFO [M:0;jenkins-hbase4:41243] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 04:04:14,060 DEBUG [M:0;jenkins-hbase4:41243] master.HMaster(1502): Stopping service threads 2023-02-13 04:04:14,060 INFO [M:0;jenkins-hbase4:41243] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 04:04:14,061 ERROR [M:0;jenkins-hbase4:41243] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 04:04:14,061 INFO [M:0;jenkins-hbase4:41243] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 04:04:14,061 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:14,061 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 04:04:14,061 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:14,061 DEBUG [M:0;jenkins-hbase4:41243] zookeeper.ZKUtil(398): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 04:04:14,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:14,061 WARN [M:0;jenkins-hbase4:41243] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 04:04:14,061 INFO [M:0;jenkins-hbase4:41243] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 04:04:14,062 INFO [M:0;jenkins-hbase4:41243] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 04:04:14,062 DEBUG [M:0;jenkins-hbase4:41243] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:04:14,062 INFO [M:0;jenkins-hbase4:41243] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:14,062 DEBUG [M:0;jenkins-hbase4:41243] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:14,062 DEBUG [M:0;jenkins-hbase4:41243] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:04:14,062 DEBUG [M:0;jenkins-hbase4:41243] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:14,062 INFO [M:0;jenkins-hbase4:41243] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.63 KB heapSize=67.59 KB 2023-02-13 04:04:14,071 INFO [M:0;jenkins-hbase4:41243] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.63 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c5c69bc0574547d18d3a2140851c71e4 2023-02-13 04:04:14,076 DEBUG [M:0;jenkins-hbase4:41243] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/c5c69bc0574547d18d3a2140851c71e4 as hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c5c69bc0574547d18d3a2140851c71e4 2023-02-13 04:04:14,079 INFO [M:0;jenkins-hbase4:41243] regionserver.HStore(1080): Added hdfs://localhost:35745/user/jenkins/test-data/7f70e8ae-1a43-1863-dd02-0beb16fc2c46/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/c5c69bc0574547d18d3a2140851c71e4, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 04:04:14,080 INFO [M:0;jenkins-hbase4:41243] regionserver.HRegion(2947): Finished flush of dataSize ~56.63 KB/57989, heapSize ~67.57 KB/69192, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-13 04:04:14,081 INFO [M:0;jenkins-hbase4:41243] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:14,081 DEBUG [M:0;jenkins-hbase4:41243] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261054062Disabling compacts and flushes for region at 1676261054062Disabling writes for close at 1676261054062Obtaining lock to block concurrent updates at 1676261054062Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676261054062Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57989, getHeapSize=69192, getOffHeapSize=0, getCellsCount=145 at 1676261054063 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676261054064 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676261054064Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676261054066 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676261054066Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676261054076 (+10 ms)Finished flush of dataSize ~56.63 KB/57989, heapSize ~67.57 KB/69192, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676261054080 (+4 ms)Writing region close event to WAL at 1676261054081 (+1 ms)Closed at 1676261054081 2023-02-13 04:04:14,084 INFO [M:0;jenkins-hbase4:41243] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 04:04:14,084 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:14,084 INFO [M:0;jenkins-hbase4:41243] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41243 2023-02-13 04:04:14,086 DEBUG [M:0;jenkins-hbase4:41243] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41243,1676261050840 already deleted, retry=false 2023-02-13 04:04:14,236 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:14,236 INFO [M:0;jenkins-hbase4:41243] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41243,1676261050840; zookeeper connection closed. 2023-02-13 04:04:14,236 ERROR [Listener at localhost/41441-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@51cd792b rejected from java.util.concurrent.ThreadPoolExecutor@55f2e7ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:14,237 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): master:41243-0x1004bd9b3890000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:14,237 ERROR [Listener at localhost/41441-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b9452e8 rejected from java.util.concurrent.ThreadPoolExecutor@55f2e7ca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:14,336 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:14,336 INFO [RS:0;jenkins-hbase4:41191] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41191,1676261050890; zookeeper connection closed. 2023-02-13 04:04:14,337 ERROR [Listener at localhost/41441-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48d3f5ae rejected from java.util.concurrent.ThreadPoolExecutor@3408896f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:14,337 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:41191-0x1004bd9b3890001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:14,337 ERROR [Listener at localhost/41441-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3002bf1e rejected from java.util.concurrent.ThreadPoolExecutor@3408896f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:14,337 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@35f08821] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@35f08821 2023-02-13 04:04:14,437 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:14,437 INFO [RS:1;jenkins-hbase4:36419] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36419,1676261050918; zookeeper connection closed. 2023-02-13 04:04:14,437 ERROR [Listener at localhost/41441-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@56cf9b06 rejected from java.util.concurrent.ThreadPoolExecutor@53645c03[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:14,437 DEBUG [Listener at localhost/41441-EventThread] zookeeper.ZKWatcher(600): regionserver:36419-0x1004bd9b3890002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:14,437 ERROR [Listener at localhost/41441-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@12c4da1c rejected from java.util.concurrent.ThreadPoolExecutor@53645c03[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:14,437 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@45b78920] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@45b78920 2023-02-13 04:04:14,437 INFO [Listener at localhost/41441] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 04:04:14,437 WARN [Listener at localhost/41441] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:04:14,441 INFO [Listener at localhost/41441] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:14,544 WARN [BP-1390050983-172.31.14.131-1676261050215 heartbeating to localhost/127.0.0.1:35745] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:04:14,545 WARN [BP-1390050983-172.31.14.131-1676261050215 heartbeating to localhost/127.0.0.1:35745] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1390050983-172.31.14.131-1676261050215 (Datanode Uuid bae9d68e-ca1e-4f02-8c53-933d6b68aa42) service to localhost/127.0.0.1:35745 2023-02-13 04:04:14,545 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/cluster_3f28eb11-a6b9-bea6-a231-eb5a4aff9cb4/dfs/data/data3/current/BP-1390050983-172.31.14.131-1676261050215] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:14,545 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/cluster_3f28eb11-a6b9-bea6-a231-eb5a4aff9cb4/dfs/data/data4/current/BP-1390050983-172.31.14.131-1676261050215] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:14,546 WARN [Listener at localhost/41441] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:04:14,549 INFO [Listener at localhost/41441] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:14,647 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 04:04:14,750 WARN [BP-1390050983-172.31.14.131-1676261050215 heartbeating to localhost/127.0.0.1:35745] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:04:14,750 WARN [BP-1390050983-172.31.14.131-1676261050215 heartbeating to localhost/127.0.0.1:35745] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1390050983-172.31.14.131-1676261050215 (Datanode Uuid 2e4962fc-13f1-4791-a712-2fb840c60881) service to localhost/127.0.0.1:35745 2023-02-13 04:04:14,751 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/cluster_3f28eb11-a6b9-bea6-a231-eb5a4aff9cb4/dfs/data/data1/current/BP-1390050983-172.31.14.131-1676261050215] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:14,751 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/cluster_3f28eb11-a6b9-bea6-a231-eb5a4aff9cb4/dfs/data/data2/current/BP-1390050983-172.31.14.131-1676261050215] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:14,764 INFO [Listener at localhost/41441] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:14,882 INFO [Listener at localhost/41441] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 04:04:14,900 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 04:04:14,912 INFO [Listener at localhost/41441] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=273 (was 253) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41441 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:35745 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35745 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:35745 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:35745 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:35745 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,41243,1676261050840)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:35745 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:35745 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=583 (was 661), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 254) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3808 (was 3843) 2023-02-13 04:04:14,923 INFO [Listener at localhost/41441] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=273, OpenFileDescriptor=583, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=168, AvailableMemoryMB=3808 2023-02-13 04:04:14,933 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/hadoop.log.dir so I do NOT create it in target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2 2023-02-13 04:04:14,933 WARN [Listener at localhost/41441] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 04:04:14,933 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/hadoop.tmp.dir so I do NOT create it in target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2 2023-02-13 04:04:14,933 WARN [Listener at localhost/41441] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/02327637-08d5-62f2-536a-401e8cf50aec/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 04:04:14,933 DEBUG [Listener at localhost/41441] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2 2023-02-13 04:04:14,934 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 04:04:14,934 INFO [Listener at localhost/41441] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/cluster_0e771705-44ed-8660-8455-552746cd4e73, deleteOnExit=true 2023-02-13 04:04:14,934 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 04:04:14,934 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/test.cache.data in system properties and HBase conf 2023-02-13 04:04:14,934 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 04:04:14,934 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/hadoop.log.dir in system properties and HBase conf 2023-02-13 04:04:14,934 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 04:04:14,934 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 04:04:14,934 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 04:04:14,934 DEBUG [Listener at localhost/41441] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 04:04:14,935 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:04:14,935 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 04:04:14,935 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 04:04:14,935 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:04:14,935 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 04:04:14,935 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 04:04:14,935 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 04:04:14,935 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:04:14,935 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 04:04:14,935 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/nfs.dump.dir in system properties and HBase conf 2023-02-13 04:04:14,936 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/java.io.tmpdir in system properties and HBase conf 2023-02-13 04:04:14,936 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 04:04:14,936 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 04:04:14,936 INFO [Listener at localhost/41441] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 04:04:14,940 WARN [Listener at localhost/41441] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:04:14,940 WARN [Listener at localhost/41441] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:04:14,992 WARN [Listener at localhost/41441] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:04:14,994 INFO [Listener at localhost/41441] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:04:14,998 INFO [Listener at localhost/41441] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/java.io.tmpdir/Jetty_localhost_42317_hdfs____var7k5/webapp 2023-02-13 04:04:15,089 INFO [Listener at localhost/41441] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42317 2023-02-13 04:04:15,094 WARN [Listener at localhost/41441] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 04:04:15,094 WARN [Listener at localhost/41441] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 04:04:15,132 WARN [Listener at localhost/35733] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:04:15,146 WARN [Listener at localhost/35733] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:04:15,148 WARN [Listener at localhost/35733] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:04:15,149 INFO [Listener at localhost/35733] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:04:15,154 INFO [Listener at localhost/35733] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/java.io.tmpdir/Jetty_localhost_36895_datanode____.uzhwnc/webapp 2023-02-13 04:04:15,245 INFO [Listener at localhost/35733] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36895 2023-02-13 04:04:15,256 WARN [Listener at localhost/42957] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:04:15,272 WARN [Listener at localhost/42957] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 04:04:15,273 WARN [Listener at localhost/42957] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 04:04:15,274 INFO [Listener at localhost/42957] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 04:04:15,277 INFO [Listener at localhost/42957] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/java.io.tmpdir/Jetty_localhost_45967_datanode____.uvqww0/webapp 2023-02-13 04:04:15,357 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4f0123efe1477647: Processing first storage report for DS-e3adfd86-8b11-491d-b327-dc5ea8e2c970 from datanode f85500f4-ee6d-44b2-aa56-ef1af6667306 2023-02-13 04:04:15,358 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4f0123efe1477647: from storage DS-e3adfd86-8b11-491d-b327-dc5ea8e2c970 node DatanodeRegistration(127.0.0.1:36457, datanodeUuid=f85500f4-ee6d-44b2-aa56-ef1af6667306, infoPort=41751, infoSecurePort=0, ipcPort=42957, storageInfo=lv=-57;cid=testClusterID;nsid=541607250;c=1676261054942), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-13 04:04:15,358 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4f0123efe1477647: Processing first storage report for DS-004ab48b-f4a5-42c7-b7c1-66a2914f96e9 from datanode f85500f4-ee6d-44b2-aa56-ef1af6667306 2023-02-13 04:04:15,358 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4f0123efe1477647: from storage DS-004ab48b-f4a5-42c7-b7c1-66a2914f96e9 node DatanodeRegistration(127.0.0.1:36457, datanodeUuid=f85500f4-ee6d-44b2-aa56-ef1af6667306, infoPort=41751, infoSecurePort=0, ipcPort=42957, storageInfo=lv=-57;cid=testClusterID;nsid=541607250;c=1676261054942), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:04:15,379 INFO [Listener at localhost/42957] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45967 2023-02-13 04:04:15,390 WARN [Listener at localhost/45365] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 04:04:15,533 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4656d4c015ba148d: Processing first storage report for DS-02d8d75c-ead8-442b-9972-d0c9bd90c884 from datanode 2a91f016-0e02-4549-971f-ab0bc97642f5 2023-02-13 04:04:15,533 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4656d4c015ba148d: from storage DS-02d8d75c-ead8-442b-9972-d0c9bd90c884 node DatanodeRegistration(127.0.0.1:33731, datanodeUuid=2a91f016-0e02-4549-971f-ab0bc97642f5, infoPort=33429, infoSecurePort=0, ipcPort=45365, storageInfo=lv=-57;cid=testClusterID;nsid=541607250;c=1676261054942), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:04:15,533 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4656d4c015ba148d: Processing first storage report for DS-c510a200-a668-4c8c-b867-768454269116 from datanode 2a91f016-0e02-4549-971f-ab0bc97642f5 2023-02-13 04:04:15,533 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4656d4c015ba148d: from storage DS-c510a200-a668-4c8c-b867-768454269116 node DatanodeRegistration(127.0.0.1:33731, datanodeUuid=2a91f016-0e02-4549-971f-ab0bc97642f5, infoPort=33429, infoSecurePort=0, ipcPort=45365, storageInfo=lv=-57;cid=testClusterID;nsid=541607250;c=1676261054942), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 04:04:15,622 DEBUG [Listener at localhost/45365] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2 2023-02-13 04:04:15,624 INFO [Listener at localhost/45365] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/cluster_0e771705-44ed-8660-8455-552746cd4e73/zookeeper_0, clientPort=60881, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/cluster_0e771705-44ed-8660-8455-552746cd4e73/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/cluster_0e771705-44ed-8660-8455-552746cd4e73/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 04:04:15,625 INFO [Listener at localhost/45365] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60881 2023-02-13 04:04:15,625 INFO [Listener at localhost/45365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,626 INFO [Listener at localhost/45365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,637 INFO [Listener at localhost/45365] util.FSUtils(479): Created version file at hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834 with version=8 2023-02-13 04:04:15,637 INFO [Listener at localhost/45365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,637 INFO [Listener at localhost/45365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,638 INFO [Listener at localhost/45365] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35733/user/jenkins/test-data/5cba1187-08f1-f0a4-2520-58dfdb5e1ea8/hbase-staging 2023-02-13 04:04:15,640 INFO [Listener at localhost/45365] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:04:15,640 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:15,640 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:15,640 INFO [Listener at localhost/45365] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:04:15,640 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:15,640 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:04:15,640 INFO [Listener at localhost/45365] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:04:15,641 INFO [Listener at localhost/45365] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40315 2023-02-13 04:04:15,641 INFO [Listener at localhost/45365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,642 INFO [Listener at localhost/45365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,643 INFO [Listener at localhost/45365] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40315 connecting to ZooKeeper ensemble=127.0.0.1:60881 2023-02-13 04:04:15,650 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:403150x0, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:04:15,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40315-0x1004bd9c64c0000 connected 2023-02-13 04:04:15,670 DEBUG [Listener at localhost/45365] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:15,671 DEBUG [Listener at localhost/45365] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:15,671 DEBUG [Listener at localhost/45365] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:04:15,672 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40315 2023-02-13 04:04:15,672 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40315 2023-02-13 04:04:15,676 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40315 2023-02-13 04:04:15,678 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40315 2023-02-13 04:04:15,678 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40315 2023-02-13 04:04:15,679 INFO [Listener at localhost/45365] master.HMaster(439): hbase.rootdir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834, hbase.cluster.distributed=false 2023-02-13 04:04:15,690 INFO [Listener at localhost/45365] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:04:15,690 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:15,691 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:15,691 INFO [Listener at localhost/45365] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:04:15,691 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:15,691 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:04:15,691 INFO [Listener at localhost/45365] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:04:15,691 INFO [Listener at localhost/45365] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32969 2023-02-13 04:04:15,692 INFO [Listener at localhost/45365] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:04:15,692 DEBUG [Listener at localhost/45365] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:15,693 INFO [Listener at localhost/45365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,694 INFO [Listener at localhost/45365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,694 INFO [Listener at localhost/45365] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32969 connecting to ZooKeeper ensemble=127.0.0.1:60881 2023-02-13 04:04:15,696 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:329690x0, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:04:15,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:32969-0x1004bd9c64c0001 connected 2023-02-13 04:04:15,699 DEBUG [Listener at localhost/45365] zookeeper.ZKUtil(164): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:15,700 DEBUG [Listener at localhost/45365] zookeeper.ZKUtil(164): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:15,700 DEBUG [Listener at localhost/45365] zookeeper.ZKUtil(164): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:04:15,704 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32969 2023-02-13 04:04:15,704 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32969 2023-02-13 04:04:15,704 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32969 2023-02-13 04:04:15,708 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32969 2023-02-13 04:04:15,708 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32969 2023-02-13 04:04:15,718 INFO [Listener at localhost/45365] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 04:04:15,719 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:15,719 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:15,719 INFO [Listener at localhost/45365] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 04:04:15,719 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 04:04:15,719 INFO [Listener at localhost/45365] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 04:04:15,719 INFO [Listener at localhost/45365] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 04:04:15,720 INFO [Listener at localhost/45365] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34421 2023-02-13 04:04:15,720 INFO [Listener at localhost/45365] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 04:04:15,720 DEBUG [Listener at localhost/45365] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:15,721 INFO [Listener at localhost/45365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,721 INFO [Listener at localhost/45365] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,722 INFO [Listener at localhost/45365] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34421 connecting to ZooKeeper ensemble=127.0.0.1:60881 2023-02-13 04:04:15,724 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:344210x0, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 04:04:15,725 DEBUG [Listener at localhost/45365] zookeeper.ZKUtil(164): regionserver:344210x0, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:15,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34421-0x1004bd9c64c0002 connected 2023-02-13 04:04:15,726 DEBUG [Listener at localhost/45365] zookeeper.ZKUtil(164): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:15,726 DEBUG [Listener at localhost/45365] zookeeper.ZKUtil(164): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 04:04:15,728 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34421 2023-02-13 04:04:15,729 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34421 2023-02-13 04:04:15,729 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34421 2023-02-13 04:04:15,730 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34421 2023-02-13 04:04:15,730 DEBUG [Listener at localhost/45365] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34421 2023-02-13 04:04:15,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40315,1676261055640 2023-02-13 04:04:15,735 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:04:15,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40315,1676261055640 2023-02-13 04:04:15,737 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:15,737 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:15,737 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:15,738 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:15,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:04:15,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40315,1676261055640 from backup master directory 2023-02-13 04:04:15,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 04:04:15,742 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40315,1676261055640 2023-02-13 04:04:15,742 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 04:04:15,742 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:04:15,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40315,1676261055640 2023-02-13 04:04:15,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/hbase.id with ID: 53a0c24b-12d9-4c64-acf2-d3de98f68cda 2023-02-13 04:04:15,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 04:04:15,761 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:15,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x618e01fe to 127.0.0.1:60881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:15,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31227bc2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:15,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:15,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 04:04:15,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:15,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/data/master/store-tmp 2023-02-13 04:04:15,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:15,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:04:15,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:15,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:15,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:04:15,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:15,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:15,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261055785Disabling compacts and flushes for region at 1676261055785Disabling writes for close at 1676261055785Writing region close event to WAL at 1676261055785Closed at 1676261055785 2023-02-13 04:04:15,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/WALs/jenkins-hbase4.apache.org,40315,1676261055640 2023-02-13 04:04:15,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40315%2C1676261055640, suffix=, logDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/WALs/jenkins-hbase4.apache.org,40315,1676261055640, archiveDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/oldWALs, maxLogs=10 2023-02-13 04:04:15,799 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33731,DS-02d8d75c-ead8-442b-9972-d0c9bd90c884,DISK] 2023-02-13 04:04:15,799 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36457,DS-e3adfd86-8b11-491d-b327-dc5ea8e2c970,DISK] 2023-02-13 04:04:15,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/WALs/jenkins-hbase4.apache.org,40315,1676261055640/jenkins-hbase4.apache.org%2C40315%2C1676261055640.1676261055787 2023-02-13 04:04:15,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33731,DS-02d8d75c-ead8-442b-9972-d0c9bd90c884,DISK], DatanodeInfoWithStorage[127.0.0.1:36457,DS-e3adfd86-8b11-491d-b327-dc5ea8e2c970,DISK]] 2023-02-13 04:04:15,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:15,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:15,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:15,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:15,802 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:15,803 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 04:04:15,804 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 04:04:15,804 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:15,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:15,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:15,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 04:04:15,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:15,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62308346, jitterRate=-0.07153329253196716}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:04:15,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676261055801Initializing all the Stores at 1676261055802 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261055802Cleaning up temporary data from old regions at 1676261055805 (+3 ms)Cleaning up detritus from prior splits at 1676261055805Region opened successfully at 1676261055808 (+3 ms) 2023-02-13 04:04:15,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 04:04:15,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 04:04:15,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 04:04:15,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 04:04:15,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 04:04:15,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 04:04:15,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 04:04:15,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 04:04:15,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 04:04:15,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 04:04:15,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 04:04:15,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 04:04:15,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 04:04:15,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 04:04:15,824 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:15,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 04:04:15,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 04:04:15,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 04:04:15,826 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:15,826 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:15,826 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:15,826 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:15,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40315,1676261055640, sessionid=0x1004bd9c64c0000, setting cluster-up flag (Was=false) 2023-02-13 04:04:15,832 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:15,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 04:04:15,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40315,1676261055640 2023-02-13 04:04:15,840 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:15,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 04:04:15,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40315,1676261055640 2023-02-13 04:04:15,845 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.hbase-snapshot/.tmp 2023-02-13 04:04:15,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 04:04:15,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:15,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:15,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:15,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 04:04:15,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 04:04:15,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:04:15,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676261085849 2023-02-13 04:04:15,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 04:04:15,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 04:04:15,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 04:04:15,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 04:04:15,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 04:04:15,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 04:04:15,850 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:04:15,850 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 04:04:15,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 04:04:15,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 04:04:15,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 04:04:15,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 04:04:15,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 04:04:15,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261055851,5,FailOnTimeoutGroup] 2023-02-13 04:04:15,851 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:15,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261055851,5,FailOnTimeoutGroup] 2023-02-13 04:04:15,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 04:04:15,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,859 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:15,860 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:15,860 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834 2023-02-13 04:04:15,866 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:15,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:04:15,868 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/info 2023-02-13 04:04:15,868 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:04:15,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:15,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:04:15,869 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:04:15,869 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:04:15,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:15,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:04:15,871 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/table 2023-02-13 04:04:15,871 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:04:15,871 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:15,872 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740 2023-02-13 04:04:15,872 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740 2023-02-13 04:04:15,873 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:04:15,874 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:04:15,880 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:15,880 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60010921, jitterRate=-0.10576759278774261}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:04:15,880 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676261055866Initializing all the Stores at 1676261055866Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261055866Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261055866Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261055866Cleaning up temporary data from old regions at 1676261055873 (+7 ms)Cleaning up detritus from prior splits at 1676261055873Region opened successfully at 1676261055880 (+7 ms) 2023-02-13 04:04:15,880 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:04:15,880 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:04:15,880 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:04:15,880 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:04:15,880 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:04:15,881 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:15,881 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261055880Disabling compacts and flushes for region at 1676261055880Disabling writes for close at 1676261055880Writing region close event to WAL at 1676261055881 (+1 ms)Closed at 1676261055881 2023-02-13 04:04:15,881 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 04:04:15,881 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 04:04:15,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 04:04:15,882 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 04:04:15,883 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 04:04:15,932 INFO [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(952): ClusterId : 53a0c24b-12d9-4c64-acf2-d3de98f68cda 2023-02-13 04:04:15,932 INFO [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(952): ClusterId : 53a0c24b-12d9-4c64-acf2-d3de98f68cda 2023-02-13 04:04:15,932 DEBUG [RS:1;jenkins-hbase4:34421] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:04:15,932 DEBUG [RS:0;jenkins-hbase4:32969] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 04:04:15,934 DEBUG [RS:1;jenkins-hbase4:34421] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:04:15,934 DEBUG [RS:1;jenkins-hbase4:34421] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:04:15,934 DEBUG [RS:0;jenkins-hbase4:32969] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 04:04:15,934 DEBUG [RS:0;jenkins-hbase4:32969] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 04:04:15,936 DEBUG [RS:1;jenkins-hbase4:34421] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:04:15,937 DEBUG [RS:1;jenkins-hbase4:34421] zookeeper.ReadOnlyZKClient(139): Connect 0x5b93c1cf to 127.0.0.1:60881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:15,937 DEBUG [RS:0;jenkins-hbase4:32969] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 04:04:15,938 DEBUG [RS:0;jenkins-hbase4:32969] zookeeper.ReadOnlyZKClient(139): Connect 0x76ffe3cb to 127.0.0.1:60881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:15,942 DEBUG [RS:1;jenkins-hbase4:34421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@555424cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:15,942 DEBUG [RS:0;jenkins-hbase4:32969] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78381364, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:15,942 DEBUG [RS:1;jenkins-hbase4:34421] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@516baabf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:04:15,942 DEBUG [RS:0;jenkins-hbase4:32969] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c0788bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:04:15,951 DEBUG [RS:1;jenkins-hbase4:34421] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34421 2023-02-13 04:04:15,951 DEBUG [RS:0;jenkins-hbase4:32969] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32969 2023-02-13 04:04:15,951 INFO [RS:1;jenkins-hbase4:34421] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:04:15,951 INFO [RS:1;jenkins-hbase4:34421] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:04:15,951 INFO [RS:0;jenkins-hbase4:32969] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 04:04:15,951 INFO [RS:0;jenkins-hbase4:32969] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 04:04:15,951 DEBUG [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:04:15,951 DEBUG [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 04:04:15,952 INFO [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40315,1676261055640 with isa=jenkins-hbase4.apache.org/172.31.14.131:34421, startcode=1676261055718 2023-02-13 04:04:15,952 INFO [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40315,1676261055640 with isa=jenkins-hbase4.apache.org/172.31.14.131:32969, startcode=1676261055690 2023-02-13 04:04:15,952 DEBUG [RS:1;jenkins-hbase4:34421] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:04:15,952 DEBUG [RS:0;jenkins-hbase4:32969] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 04:04:15,953 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34283, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:04:15,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:15,955 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46311, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 04:04:15,956 DEBUG [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834 2023-02-13 04:04:15,956 DEBUG [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35733 2023-02-13 04:04:15,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:15,956 DEBUG [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:04:15,956 DEBUG [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834 2023-02-13 04:04:15,956 DEBUG [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35733 2023-02-13 04:04:15,956 DEBUG [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 04:04:15,957 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:15,967 DEBUG [RS:0;jenkins-hbase4:32969] zookeeper.ZKUtil(162): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:15,967 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32969,1676261055690] 2023-02-13 04:04:15,967 WARN [RS:0;jenkins-hbase4:32969] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:04:15,967 DEBUG [RS:1;jenkins-hbase4:34421] zookeeper.ZKUtil(162): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:15,967 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34421,1676261055718] 2023-02-13 04:04:15,967 WARN [RS:1;jenkins-hbase4:34421] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 04:04:15,967 INFO [RS:0;jenkins-hbase4:32969] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:15,967 INFO [RS:1;jenkins-hbase4:34421] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:15,967 DEBUG [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/WALs/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:15,967 DEBUG [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/WALs/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:15,973 DEBUG [RS:1;jenkins-hbase4:34421] zookeeper.ZKUtil(162): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:15,973 DEBUG [RS:0;jenkins-hbase4:32969] zookeeper.ZKUtil(162): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:15,973 DEBUG [RS:1;jenkins-hbase4:34421] zookeeper.ZKUtil(162): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:15,973 DEBUG [RS:0;jenkins-hbase4:32969] zookeeper.ZKUtil(162): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:15,974 DEBUG [RS:1;jenkins-hbase4:34421] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:04:15,974 INFO [RS:1;jenkins-hbase4:34421] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:04:15,974 DEBUG [RS:0;jenkins-hbase4:32969] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 04:04:15,975 INFO [RS:0;jenkins-hbase4:32969] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 04:04:15,978 INFO [RS:1;jenkins-hbase4:34421] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:04:15,979 INFO [RS:0;jenkins-hbase4:32969] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 04:04:15,979 INFO [RS:1;jenkins-hbase4:34421] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:04:15,979 INFO [RS:1;jenkins-hbase4:34421] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,980 INFO [RS:0;jenkins-hbase4:32969] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 04:04:15,980 INFO [RS:0;jenkins-hbase4:32969] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,980 INFO [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:04:15,983 INFO [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 04:04:15,985 INFO [RS:0;jenkins-hbase4:32969] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,985 INFO [RS:1;jenkins-hbase4:34421] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,985 DEBUG [RS:0;jenkins-hbase4:32969] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,985 DEBUG [RS:1;jenkins-hbase4:34421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,985 DEBUG [RS:0;jenkins-hbase4:32969] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,985 DEBUG [RS:1;jenkins-hbase4:34421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,985 DEBUG [RS:0;jenkins-hbase4:32969] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,985 DEBUG [RS:1;jenkins-hbase4:34421] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,985 DEBUG [RS:0;jenkins-hbase4:32969] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:1;jenkins-hbase4:34421] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:0;jenkins-hbase4:32969] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:1;jenkins-hbase4:34421] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:0;jenkins-hbase4:32969] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:04:15,986 DEBUG [RS:1;jenkins-hbase4:34421] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 04:04:15,986 DEBUG [RS:0;jenkins-hbase4:32969] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:1;jenkins-hbase4:34421] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:0;jenkins-hbase4:32969] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:1;jenkins-hbase4:34421] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:0;jenkins-hbase4:32969] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:1;jenkins-hbase4:34421] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:0;jenkins-hbase4:32969] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,986 DEBUG [RS:1;jenkins-hbase4:34421] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 04:04:15,987 INFO [RS:0;jenkins-hbase4:32969] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,988 INFO [RS:0;jenkins-hbase4:32969] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,988 INFO [RS:0;jenkins-hbase4:32969] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,992 INFO [RS:1;jenkins-hbase4:34421] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,992 INFO [RS:1;jenkins-hbase4:34421] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:15,992 INFO [RS:1;jenkins-hbase4:34421] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:16,002 INFO [RS:0;jenkins-hbase4:32969] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:04:16,002 INFO [RS:0;jenkins-hbase4:32969] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32969,1676261055690-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:16,003 INFO [RS:1;jenkins-hbase4:34421] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 04:04:16,003 INFO [RS:1;jenkins-hbase4:34421] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34421,1676261055718-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:16,012 INFO [RS:0;jenkins-hbase4:32969] regionserver.Replication(203): jenkins-hbase4.apache.org,32969,1676261055690 started 2023-02-13 04:04:16,012 INFO [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,32969,1676261055690, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32969, sessionid=0x1004bd9c64c0001 2023-02-13 04:04:16,012 DEBUG [RS:0;jenkins-hbase4:32969] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:04:16,013 DEBUG [RS:0;jenkins-hbase4:32969] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:16,013 DEBUG [RS:0;jenkins-hbase4:32969] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32969,1676261055690' 2023-02-13 04:04:16,013 DEBUG [RS:0;jenkins-hbase4:32969] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:16,013 DEBUG [RS:0;jenkins-hbase4:32969] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:16,013 DEBUG [RS:0;jenkins-hbase4:32969] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:04:16,013 DEBUG [RS:0;jenkins-hbase4:32969] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:04:16,013 DEBUG [RS:0;jenkins-hbase4:32969] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:16,013 DEBUG [RS:0;jenkins-hbase4:32969] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32969,1676261055690' 2023-02-13 04:04:16,013 DEBUG [RS:0;jenkins-hbase4:32969] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:16,014 DEBUG [RS:0;jenkins-hbase4:32969] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:16,014 DEBUG [RS:0;jenkins-hbase4:32969] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:04:16,014 INFO [RS:0;jenkins-hbase4:32969] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:04:16,014 INFO [RS:0;jenkins-hbase4:32969] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:04:16,017 INFO [RS:1;jenkins-hbase4:34421] regionserver.Replication(203): jenkins-hbase4.apache.org,34421,1676261055718 started 2023-02-13 04:04:16,017 INFO [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34421,1676261055718, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34421, sessionid=0x1004bd9c64c0002 2023-02-13 04:04:16,018 DEBUG [RS:1;jenkins-hbase4:34421] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 04:04:16,018 DEBUG [RS:1;jenkins-hbase4:34421] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:16,018 DEBUG [RS:1;jenkins-hbase4:34421] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34421,1676261055718' 2023-02-13 04:04:16,018 DEBUG [RS:1;jenkins-hbase4:34421] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:16,018 DEBUG [RS:1;jenkins-hbase4:34421] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:16,018 DEBUG [RS:1;jenkins-hbase4:34421] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 04:04:16,018 DEBUG [RS:1;jenkins-hbase4:34421] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 04:04:16,018 DEBUG [RS:1;jenkins-hbase4:34421] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:16,018 DEBUG [RS:1;jenkins-hbase4:34421] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34421,1676261055718' 2023-02-13 04:04:16,018 DEBUG [RS:1;jenkins-hbase4:34421] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:16,019 DEBUG [RS:1;jenkins-hbase4:34421] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:16,019 DEBUG [RS:1;jenkins-hbase4:34421] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 04:04:16,019 INFO [RS:1;jenkins-hbase4:34421] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 04:04:16,019 INFO [RS:1;jenkins-hbase4:34421] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 04:04:16,033 DEBUG [jenkins-hbase4:40315] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 04:04:16,034 DEBUG [jenkins-hbase4:40315] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:04:16,035 DEBUG [jenkins-hbase4:40315] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:04:16,035 DEBUG [jenkins-hbase4:40315] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:04:16,035 DEBUG [jenkins-hbase4:40315] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:04:16,035 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32969,1676261055690, state=OPENING 2023-02-13 04:04:16,036 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 04:04:16,037 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:16,038 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:04:16,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32969,1676261055690}] 2023-02-13 04:04:16,192 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:16,193 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:04:16,194 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37978, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:04:16,198 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 04:04:16,198 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 04:04:16,199 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32969%2C1676261055690.meta, suffix=.meta, logDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/WALs/jenkins-hbase4.apache.org,32969,1676261055690, archiveDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/oldWALs, maxLogs=32 2023-02-13 04:04:16,214 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33731,DS-02d8d75c-ead8-442b-9972-d0c9bd90c884,DISK] 2023-02-13 04:04:16,214 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36457,DS-e3adfd86-8b11-491d-b327-dc5ea8e2c970,DISK] 2023-02-13 04:04:16,216 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/WALs/jenkins-hbase4.apache.org,32969,1676261055690/jenkins-hbase4.apache.org%2C32969%2C1676261055690.meta.1676261056199.meta 2023-02-13 04:04:16,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36457,DS-e3adfd86-8b11-491d-b327-dc5ea8e2c970,DISK], DatanodeInfoWithStorage[127.0.0.1:33731,DS-02d8d75c-ead8-442b-9972-d0c9bd90c884,DISK]] 2023-02-13 04:04:16,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:16,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 04:04:16,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 04:04:16,217 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 04:04:16,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 04:04:16,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:16,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 04:04:16,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 04:04:16,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 04:04:16,219 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/info 2023-02-13 04:04:16,219 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/info 2023-02-13 04:04:16,219 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 04:04:16,220 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:16,220 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 04:04:16,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:04:16,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/rep_barrier 2023-02-13 04:04:16,221 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 04:04:16,221 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:16,221 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 04:04:16,222 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/table 2023-02-13 04:04:16,222 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/table 2023-02-13 04:04:16,222 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 04:04:16,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:16,223 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740 2023-02-13 04:04:16,224 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740 2023-02-13 04:04:16,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 04:04:16,226 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 04:04:16,227 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58986699, jitterRate=-0.12102968990802765}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 04:04:16,227 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676261056217Writing region info on filesystem at 1676261056217Initializing all the Stores at 1676261056217Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261056218 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261056218Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261056218Cleaning up temporary data from old regions at 1676261056225 (+7 ms)Cleaning up detritus from prior splits at 1676261056225Running coprocessor post-open hooks at 1676261056227 (+2 ms)Region opened successfully at 1676261056227 2023-02-13 04:04:16,227 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676261056192 2023-02-13 04:04:16,231 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 04:04:16,232 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 04:04:16,232 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32969,1676261055690, state=OPEN 2023-02-13 04:04:16,233 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 04:04:16,234 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 04:04:16,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 04:04:16,235 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32969,1676261055690 in 196 msec 2023-02-13 04:04:16,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 04:04:16,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 354 msec 2023-02-13 04:04:16,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 391 msec 2023-02-13 04:04:16,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676261055735, completionTime=-1 2023-02-13 04:04:16,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 04:04:16,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 04:04:16,239 DEBUG [hconnection-0x6c2330a3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:16,241 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:16,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 04:04:16,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676261116242 2023-02-13 04:04:16,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676261176242 2023-02-13 04:04:16,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-13 04:04:16,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40315,1676261055640-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:16,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40315,1676261055640-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:16,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40315,1676261055640-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:16,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40315, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:16,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 04:04:16,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 04:04:16,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:16,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 04:04:16,250 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 04:04:16,250 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:04:16,251 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:04:16,252 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:16,253 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad empty. 2023-02-13 04:04:16,253 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:16,253 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 04:04:16,261 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:16,262 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1980962eeaae32cc8f087063b7e12dad, NAME => 'hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp 2023-02-13 04:04:16,271 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:16,271 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 1980962eeaae32cc8f087063b7e12dad, disabling compactions & flushes 2023-02-13 04:04:16,271 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:16,271 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:16,271 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. after waiting 0 ms 2023-02-13 04:04:16,271 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:16,271 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:16,271 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 1980962eeaae32cc8f087063b7e12dad: Waiting for close lock at 1676261056271Disabling compacts and flushes for region at 1676261056271Disabling writes for close at 1676261056271Writing region close event to WAL at 1676261056271Closed at 1676261056271 2023-02-13 04:04:16,273 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:04:16,274 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261056274"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261056274"}]},"ts":"1676261056274"} 2023-02-13 04:04:16,275 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:04:16,275 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:04:16,276 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261056276"}]},"ts":"1676261056276"} 2023-02-13 04:04:16,277 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 04:04:16,279 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:04:16,280 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:04:16,280 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:04:16,280 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:04:16,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1980962eeaae32cc8f087063b7e12dad, ASSIGN}] 2023-02-13 04:04:16,282 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1980962eeaae32cc8f087063b7e12dad, ASSIGN 2023-02-13 04:04:16,282 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1980962eeaae32cc8f087063b7e12dad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32969,1676261055690; forceNewPlan=false, retain=false 2023-02-13 04:04:16,432 INFO [jenkins-hbase4:40315] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:04:16,433 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1980962eeaae32cc8f087063b7e12dad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:16,433 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261056433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261056433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261056433"}]},"ts":"1676261056433"} 2023-02-13 04:04:16,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1980962eeaae32cc8f087063b7e12dad, server=jenkins-hbase4.apache.org,32969,1676261055690}] 2023-02-13 04:04:16,589 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:16,590 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32969%2C1676261055690, suffix=, logDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/WALs/jenkins-hbase4.apache.org,32969,1676261055690, archiveDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/oldWALs, maxLogs=32 2023-02-13 04:04:16,603 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33731,DS-02d8d75c-ead8-442b-9972-d0c9bd90c884,DISK] 2023-02-13 04:04:16,603 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36457,DS-e3adfd86-8b11-491d-b327-dc5ea8e2c970,DISK] 2023-02-13 04:04:16,605 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/WALs/jenkins-hbase4.apache.org,32969,1676261055690/jenkins-hbase4.apache.org%2C32969%2C1676261055690.1676261056590 2023-02-13 04:04:16,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33731,DS-02d8d75c-ead8-442b-9972-d0c9bd90c884,DISK], DatanodeInfoWithStorage[127.0.0.1:36457,DS-e3adfd86-8b11-491d-b327-dc5ea8e2c970,DISK]] 2023-02-13 04:04:16,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1980962eeaae32cc8f087063b7e12dad, NAME => 'hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:16,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:16,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:16,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:16,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:16,607 INFO [StoreOpener-1980962eeaae32cc8f087063b7e12dad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:16,608 DEBUG [StoreOpener-1980962eeaae32cc8f087063b7e12dad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad/info 2023-02-13 04:04:16,608 DEBUG [StoreOpener-1980962eeaae32cc8f087063b7e12dad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad/info 2023-02-13 04:04:16,608 INFO [StoreOpener-1980962eeaae32cc8f087063b7e12dad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1980962eeaae32cc8f087063b7e12dad columnFamilyName info 2023-02-13 04:04:16,609 INFO [StoreOpener-1980962eeaae32cc8f087063b7e12dad-1] regionserver.HStore(310): Store=1980962eeaae32cc8f087063b7e12dad/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:16,609 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:16,610 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:16,612 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:16,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:16,614 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1980962eeaae32cc8f087063b7e12dad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68853260, jitterRate=0.025993525981903076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 04:04:16,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1980962eeaae32cc8f087063b7e12dad: Running coprocessor pre-open hook at 1676261056606Writing region info on filesystem at 1676261056606Initializing all the Stores at 1676261056606Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676261056607 (+1 ms)Cleaning up temporary data from old regions at 1676261056610 (+3 ms)Cleaning up detritus from prior splits at 1676261056610Running coprocessor post-open hooks at 1676261056614 (+4 ms)Region opened successfully at 1676261056614 2023-02-13 04:04:16,615 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad., pid=6, masterSystemTime=1676261056586 2023-02-13 04:04:16,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:16,616 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:16,616 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1980962eeaae32cc8f087063b7e12dad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:16,616 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676261056616"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261056616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261056616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261056616"}]},"ts":"1676261056616"} 2023-02-13 04:04:16,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 04:04:16,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1980962eeaae32cc8f087063b7e12dad, server=jenkins-hbase4.apache.org,32969,1676261055690 in 184 msec 2023-02-13 04:04:16,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 04:04:16,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1980962eeaae32cc8f087063b7e12dad, ASSIGN in 339 msec 2023-02-13 04:04:16,621 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:04:16,621 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261056621"}]},"ts":"1676261056621"} 2023-02-13 04:04:16,622 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 04:04:16,628 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:04:16,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 380 msec 2023-02-13 04:04:16,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 04:04:16,651 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:04:16,651 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:16,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 04:04:16,660 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:04:16,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-13 04:04:16,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 04:04:16,672 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 04:04:16,674 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-13 04:04:16,679 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 04:04:16,681 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 04:04:16,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.940sec 2023-02-13 04:04:16,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 04:04:16,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 04:04:16,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 04:04:16,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40315,1676261055640-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 04:04:16,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40315,1676261055640-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 04:04:16,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 04:04:16,733 DEBUG [Listener at localhost/45365] zookeeper.ReadOnlyZKClient(139): Connect 0x64f24106 to 127.0.0.1:60881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:16,736 DEBUG [Listener at localhost/45365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b69468b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:16,737 DEBUG [hconnection-0x78341251-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:16,739 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:16,740 INFO [Listener at localhost/45365] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40315,1676261055640 2023-02-13 04:04:16,741 DEBUG [Listener at localhost/45365] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 04:04:16,743 DEBUG [Listener at localhost/45365] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 04:04:16,744 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53424, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 04:04:16,744 INFO [Listener at localhost/45365] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 04:04:16,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 04:04:16,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 04:04:16,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:53424 deadline: 1676261116745, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 04:04:16,745 INFO [Listener at localhost/45365] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 04:04:16,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 04:04:16,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 04:04:16,749 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 04:04:16,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 04:04:16,750 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 04:04:16,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:16,751 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:16,752 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b empty. 2023-02-13 04:04:16,752 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:16,752 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 04:04:16,759 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 04:04:16,760 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f5be80b08306bbed37f5cfa5f799a79b, NAME => 'testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp 2023-02-13 04:04:16,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:16,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f5be80b08306bbed37f5cfa5f799a79b, disabling compactions & flushes 2023-02-13 04:04:16,770 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:16,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:16,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. after waiting 0 ms 2023-02-13 04:04:16,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:16,770 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:16,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f5be80b08306bbed37f5cfa5f799a79b: Waiting for close lock at 1676261056770Disabling compacts and flushes for region at 1676261056770Disabling writes for close at 1676261056770Writing region close event to WAL at 1676261056770Closed at 1676261056770 2023-02-13 04:04:16,771 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 04:04:16,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676261056772"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261056772"}]},"ts":"1676261056772"} 2023-02-13 04:04:16,774 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 04:04:16,774 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 04:04:16,774 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261056774"}]},"ts":"1676261056774"} 2023-02-13 04:04:16,775 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 04:04:16,778 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 04:04:16,779 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 04:04:16,779 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 04:04:16,779 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 04:04:16,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f5be80b08306bbed37f5cfa5f799a79b, ASSIGN}] 2023-02-13 04:04:16,780 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f5be80b08306bbed37f5cfa5f799a79b, ASSIGN 2023-02-13 04:04:16,781 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f5be80b08306bbed37f5cfa5f799a79b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34421,1676261055718; forceNewPlan=false, retain=false 2023-02-13 04:04:16,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:16,931 INFO [jenkins-hbase4:40315] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 04:04:16,931 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f5be80b08306bbed37f5cfa5f799a79b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:16,931 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676261056931"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261056931"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261056931"}]},"ts":"1676261056931"} 2023-02-13 04:04:16,933 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure f5be80b08306bbed37f5cfa5f799a79b, server=jenkins-hbase4.apache.org,34421,1676261055718}] 2023-02-13 04:04:17,020 INFO [RS:1;jenkins-hbase4:34421] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34421%2C1676261055718, suffix=, logDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/WALs/jenkins-hbase4.apache.org,34421,1676261055718, archiveDir=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/oldWALs, maxLogs=32 2023-02-13 04:04:17,035 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36457,DS-e3adfd86-8b11-491d-b327-dc5ea8e2c970,DISK] 2023-02-13 04:04:17,035 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33731,DS-02d8d75c-ead8-442b-9972-d0c9bd90c884,DISK] 2023-02-13 04:04:17,037 INFO [RS:1;jenkins-hbase4:34421] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/WALs/jenkins-hbase4.apache.org,34421,1676261055718/jenkins-hbase4.apache.org%2C34421%2C1676261055718.1676261057021 2023-02-13 04:04:17,037 DEBUG [RS:1;jenkins-hbase4:34421] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33731,DS-02d8d75c-ead8-442b-9972-d0c9bd90c884,DISK], DatanodeInfoWithStorage[127.0.0.1:36457,DS-e3adfd86-8b11-491d-b327-dc5ea8e2c970,DISK]] 2023-02-13 04:04:17,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:17,085 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,085 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 04:04:17,087 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37434, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 04:04:17,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:17,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f5be80b08306bbed37f5cfa5f799a79b, NAME => 'testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.', STARTKEY => '', ENDKEY => ''} 2023-02-13 04:04:17,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:17,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:17,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:17,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:17,092 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:17,093 DEBUG [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1 2023-02-13 04:04:17,093 DEBUG [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1 2023-02-13 04:04:17,093 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5be80b08306bbed37f5cfa5f799a79b columnFamilyName f1 2023-02-13 04:04:17,093 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] regionserver.HStore(310): Store=f5be80b08306bbed37f5cfa5f799a79b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:17,094 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:17,094 DEBUG [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2 2023-02-13 04:04:17,095 DEBUG [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2 2023-02-13 04:04:17,095 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5be80b08306bbed37f5cfa5f799a79b columnFamilyName f2 2023-02-13 04:04:17,095 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] regionserver.HStore(310): Store=f5be80b08306bbed37f5cfa5f799a79b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:17,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:17,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:17,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 04:04:17,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f5be80b08306bbed37f5cfa5f799a79b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60782985, jitterRate=-0.09426294267177582}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:17,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f5be80b08306bbed37f5cfa5f799a79b: Running coprocessor pre-open hook at 1676261057091Writing region info on filesystem at 1676261057091Initializing all the Stores at 1676261057091Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261057091Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261057092 (+1 ms)Cleaning up temporary data from old regions at 1676261057096 (+4 ms)Cleaning up detritus from prior splits at 1676261057097 (+1 ms)Running coprocessor post-open hooks at 1676261057100 (+3 ms)Region opened successfully at 1676261057100 2023-02-13 04:04:17,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b., pid=12, masterSystemTime=1676261057085 2023-02-13 04:04:17,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:17,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:17,106 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f5be80b08306bbed37f5cfa5f799a79b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,106 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676261057106"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676261057106"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676261057106"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676261057106"}]},"ts":"1676261057106"} 2023-02-13 04:04:17,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 04:04:17,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure f5be80b08306bbed37f5cfa5f799a79b, server=jenkins-hbase4.apache.org,34421,1676261055718 in 174 msec 2023-02-13 04:04:17,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 04:04:17,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f5be80b08306bbed37f5cfa5f799a79b, ASSIGN in 330 msec 2023-02-13 04:04:17,111 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 04:04:17,111 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261057111"}]},"ts":"1676261057111"} 2023-02-13 04:04:17,112 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 04:04:17,114 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 04:04:17,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 367 msec 2023-02-13 04:04:17,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 04:04:17,355 INFO [Listener at localhost/45365] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 04:04:17,355 DEBUG [Listener at localhost/45365] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 04:04:17,355 INFO [Listener at localhost/45365] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:04:17,357 INFO [Listener at localhost/45365] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 04:04:17,357 INFO [Listener at localhost/45365] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 04:04:17,357 INFO [Listener at localhost/45365] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 04:04:17,357 INFO [Listener at localhost/45365] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 04:04:17,368 DEBUG [hconnection-0x78341251-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:17,380 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37444, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:17,391 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34421] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:17,474 INFO [Listener at localhost/45365] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 04:04:17,475 INFO [Listener at localhost/45365] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 04:04:17,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 04:04:17,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676261057476 (current time:1676261057476). 2023-02-13 04:04:17,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 04:04:17,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] zookeeper.ReadOnlyZKClient(139): Connect 0x2a177a3a to 127.0.0.1:60881 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 04:04:17,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5283562f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 04:04:17,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 04:04:17,481 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 04:04:17,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a177a3a to 127.0.0.1:60881 2023-02-13 04:04:17,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:17,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 04:04:17,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 04:04:17,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 04:04:17,485 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 04:04:17,486 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676261657486 2023-02-13 04:04:17,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 04:04:17,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 04:04:17,487 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 04:04:17,488 DEBUG [Listener at localhost/45365] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 04:04:17,488 DEBUG [Listener at localhost/45365] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 04:04:17,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 04:04:17,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-13 04:04:17,489 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 04:04:17,490 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676261657490 2023-02-13 04:04:17,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-13 04:04:17,497 INFO [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-13 04:04:17,497 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:04:17,498 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-13 04:04:17,498 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 04:04:17,498 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,498 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 04:04:17,500 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,500 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:17,500 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:17,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:17,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:17,501 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,501 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:04:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 04:04:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 04:04:17,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-13 04:04:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-13 04:04:17,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 04:04:17,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 04:04:17,502 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-13 04:04:17,502 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-13 04:04:17,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-13 04:04:17,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-13 04:04:17,503 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-13 04:04:17,503 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:04:17,504 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-13 04:04:17,504 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 04:04:17,504 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 04:04:17,504 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-13 04:04:17,504 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32969,1676261055690' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-13 04:04:17,506 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 04:04:17,506 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-13 04:04:17,506 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34421,1676261055718' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-13 04:04:17,508 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,509 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,509 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,509 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:17,509 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:17,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:17,509 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,509 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:17,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:17,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:17,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 04:04:17,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:17,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34421,1676261055718' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-13 04:04:17,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fcfea82[Count = 0] remaining members to acquire global barrier 2023-02-13 04:04:17,511 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 04:04:17,511 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,512 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,512 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,512 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,512 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 04:04:17,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,512 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-13 04:04:17,512 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 04:04:17,512 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:04:17,512 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,32969,1676261055690' in zk 2023-02-13 04:04:17,512 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 04:04:17,512 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 04:04:17,513 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:17,513 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. started... 2023-02-13 04:04:17,513 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f5be80b08306bbed37f5cfa5f799a79b 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 04:04:17,514 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-13 04:04:17,514 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:17,514 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-13 04:04:17,532 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/.tmp/f1/d70caed992b446e89f977c7ccc316029 2023-02-13 04:04:17,550 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/.tmp/f2/76ff7afe1f3f4f339748b3cd356e6507 2023-02-13 04:04:17,553 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/.tmp/f1/d70caed992b446e89f977c7ccc316029 as hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/d70caed992b446e89f977c7ccc316029 2023-02-13 04:04:17,556 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/d70caed992b446e89f977c7ccc316029, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 04:04:17,557 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/.tmp/f2/76ff7afe1f3f4f339748b3cd356e6507 as hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/76ff7afe1f3f4f339748b3cd356e6507 2023-02-13 04:04:17,559 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/76ff7afe1f3f4f339748b3cd356e6507, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 04:04:17,560 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for f5be80b08306bbed37f5cfa5f799a79b in 47ms, sequenceid=5, compaction requested=false 2023-02-13 04:04:17,560 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f5be80b08306bbed37f5cfa5f799a79b: 2023-02-13 04:04:17,560 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-13 04:04:17,560 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 04:04:17,560 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/d70caed992b446e89f977c7ccc316029] hfiles 2023-02-13 04:04:17,560 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/d70caed992b446e89f977c7ccc316029 for snapshot=testWithMapReduceSingleRegion 2023-02-13 04:04:17,560 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/76ff7afe1f3f4f339748b3cd356e6507] hfiles 2023-02-13 04:04:17,561 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/76ff7afe1f3f4f339748b3cd356e6507 for snapshot=testWithMapReduceSingleRegion 2023-02-13 04:04:17,566 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. completed. 2023-02-13 04:04:17,566 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:17,566 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 04:04:17,566 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 04:04:17,566 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,566 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-13 04:04:17,566 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34421,1676261055718' in zk 2023-02-13 04:04:17,568 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,568 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-13 04:04:17,568 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:17,568 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-13 04:04:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 04:04:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 04:04:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,34421,1676261055718': 2023-02-13 04:04:17,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34421,1676261055718' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 04:04:17,571 INFO [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-13 04:04:17,571 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:04:17,571 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:04:17,571 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-13 04:04:17,571 INFO [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 04:04:17,572 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,572 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,572 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:17,572 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,572 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 04:04:17,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:17,573 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:17,573 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 04:04:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 04:04:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,575 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,575 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:17,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 04:04:17,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 04:04:17,581 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-13 04:04:17,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:17,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 04:04:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 04:04:17,581 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 04:04:17,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 04:04:17,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 04:04:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 04:04:17,581 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 04:04:17,588 DEBUG [Listener at localhost/45365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:04:17,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:04:17,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 04:04:17,589 DEBUG [Listener at localhost/45365] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 04:04:17,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-13 04:04:17,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-13 04:04:17,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 04:04:17,609 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 04:04:17,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676261057486Consolidate snapshot: testWithMapReduceSingleRegion at 1676261057581 (+95 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676261057581Writing data manifest for testWithMapReduceSingleRegion at 1676261057583 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676261057589 (+6 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676261057609 (+20 ms) 2023-02-13 04:04:17,610 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 04:04:17,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 124 msec 2023-02-13 04:04:17,790 DEBUG [Listener at localhost/45365] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 04:04:17,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 04:04:17,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 04:04:17,791 INFO [Listener at localhost/45365] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 04:04:17,794 INFO [Listener at localhost/45365] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 04:04:17,798 INFO [Listener at localhost/45365] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 04:04:17,825 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34421] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:17,903 INFO [Listener at localhost/45365] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 04:04:17,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 04:04:17,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 04:04:17,909 INFO [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 04:04:17,909 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:17,909 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 04:04:17,909 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 04:04:17,910 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,910 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:04:17,911 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:17,911 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:17,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:17,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:17,911 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:17,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:17,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:04:17,911 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:04:17,911 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 04:04:17,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:04:17,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:04:17,912 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 04:04:17,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 04:04:17,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:04:17,912 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 04:04:17,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 04:04:17,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 04:04:17,912 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 04:04:17,912 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:17,912 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 04:04:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 04:04:17,912 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 04:04:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 04:04:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 04:04:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32969,1676261055690' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 04:04:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 04:04:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 04:04:17,913 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:17,913 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. started... 2023-02-13 04:04:17,913 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f5be80b08306bbed37f5cfa5f799a79b 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 04:04:17,914 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,914 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,914 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:17,933 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/.tmp/f1/a8198f1b047e47b6a6fe5f2ac9c13aea 2023-02-13 04:04:17,950 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/.tmp/f2/79ac494353a248c7a5716bdf1d8f2a5d 2023-02-13 04:04:17,954 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/.tmp/f1/a8198f1b047e47b6a6fe5f2ac9c13aea as hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/a8198f1b047e47b6a6fe5f2ac9c13aea 2023-02-13 04:04:17,957 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/a8198f1b047e47b6a6fe5f2ac9c13aea, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 04:04:17,958 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/.tmp/f2/79ac494353a248c7a5716bdf1d8f2a5d as hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/79ac494353a248c7a5716bdf1d8f2a5d 2023-02-13 04:04:17,961 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/79ac494353a248c7a5716bdf1d8f2a5d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 04:04:17,962 INFO [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for f5be80b08306bbed37f5cfa5f799a79b in 49ms, sequenceid=9, compaction requested=false 2023-02-13 04:04:17,962 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f5be80b08306bbed37f5cfa5f799a79b: 2023-02-13 04:04:17,962 DEBUG [rs(jenkins-hbase4.apache.org,34421,1676261055718)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 04:04:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 04:04:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 04:04:17,962 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34421,1676261055718' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 04:04:17,964 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,964 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:17,964 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,964 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 04:04:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:17,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:04:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:17,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34421,1676261055718' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 04:04:17,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bf06fa3[Count = 0] remaining members to acquire global barrier 2023-02-13 04:04:17,965 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 04:04:17,966 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,970 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,970 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 04:04:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 04:04:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 04:04:17,970 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,970 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 04:04:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,32969,1676261055690' in zk 2023-02-13 04:04:17,970 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 04:04:17,971 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34421,1676261055718' in zk 2023-02-13 04:04:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 04:04:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:17,972 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,32969,1676261055690' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 04:04:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 04:04:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,34421,1676261055718' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 04:04:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:04:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:04:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,34421,1676261055718': 2023-02-13 04:04:17,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34421,1676261055718' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 04:04:17,975 INFO [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 04:04:17,975 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 04:04:17,975 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 04:04:17,975 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 04:04:17,975 INFO [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 04:04:17,976 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,976 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,976 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:17,976 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,976 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 04:04:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 04:04:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,977 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 04:04:17,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:17,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:04:17,977 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 04:04:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:04:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,978 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 04:04:17,979 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 04:04:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,981 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,981 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:17,981 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 04:04:17,981 DEBUG [(jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 04:04:17,981 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:04:17,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 04:04:17,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 04:04:17,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:17,981 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:17,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 04:04:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 04:04:17,981 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 04:04:17,981 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,982 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 04:04:17,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:17,982 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:17,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 04:04:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 04:04:17,982 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,982 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:17,982 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 04:04:17,982 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 04:04:17,982 DEBUG [Listener at localhost/45365] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 04:04:17,982 DEBUG [Listener at localhost/45365] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 04:04:18,083 DEBUG [Listener at localhost/45365] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 04:04:18,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 04:04:18,171 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/hadoop-1492074907895290374.jar 2023-02-13 04:04:18,175 INFO [Listener at localhost/45365] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676261057476 type: FLUSH version: 2 ttl: 0 2023-02-13 04:04:18,175 DEBUG [Listener at localhost/45365] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35733/user/jenkins/test-data/5cba1187-08f1-f0a4-2520-58dfdb5e1ea8/testWithMapReduceSingleRegion/13d84c85-132d-4d94-bd05-e7f43e8192fa/data/default/testWithMapReduce 2023-02-13 04:04:18,175 INFO [Listener at localhost/45365] snapshot.RestoreSnapshotHelper(239): region to add: f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:18,175 INFO [Listener at localhost/45365] snapshot.RestoreSnapshotHelper(585): clone region=f5be80b08306bbed37f5cfa5f799a79b as f5be80b08306bbed37f5cfa5f799a79b in snapshot testWithMapReduceSingleRegion 2023-02-13 04:04:18,176 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => f5be80b08306bbed37f5cfa5f799a79b, NAME => 'testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35733/user/jenkins/test-data/5cba1187-08f1-f0a4-2520-58dfdb5e1ea8/testWithMapReduceSingleRegion/13d84c85-132d-4d94-bd05-e7f43e8192fa 2023-02-13 04:04:18,182 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:18,183 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d70caed992b446e89f977c7ccc316029 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-13 04:04:18,185 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 76ff7afe1f3f4f339748b3cd356e6507 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-13 04:04:18,187 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing f5be80b08306bbed37f5cfa5f799a79b, disabling compactions & flushes 2023-02-13 04:04:18,187 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:18,187 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:18,187 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. after waiting 0 ms 2023-02-13 04:04:18,187 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:18,187 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:18,187 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for f5be80b08306bbed37f5cfa5f799a79b: Waiting for close lock at 1676261058187Disabling compacts and flushes for region at 1676261058187Disabling writes for close at 1676261058187Writing region close event to WAL at 1676261058187Closed at 1676261058187 2023-02-13 04:04:18,187 INFO [Listener at localhost/45365] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676261057476 type: FLUSH version: 2 ttl: 0 2023-02-13 04:04:18,188 DEBUG [Listener at localhost/45365] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35733/user/jenkins/test-data/5cba1187-08f1-f0a4-2520-58dfdb5e1ea8/testWithMapReduceSingleRegion/13d84c85-132d-4d94-bd05-e7f43e8192fa 2023-02-13 04:04:18,188 DEBUG [Listener at localhost/45365] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35733/user/jenkins/test-data/5cba1187-08f1-f0a4-2520-58dfdb5e1ea8/testWithMapReduceSingleRegion/13d84c85-132d-4d94-bd05-e7f43e8192fa 2023-02-13 04:04:18,188 DEBUG [Listener at localhost/45365] util.CommonFSUtils(699): |-data/ 2023-02-13 04:04:18,188 DEBUG [Listener at localhost/45365] util.CommonFSUtils(699): |----default/ 2023-02-13 04:04:18,189 DEBUG [Listener at localhost/45365] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 04:04:18,189 DEBUG [Listener at localhost/45365] util.CommonFSUtils(699): |----------f5be80b08306bbed37f5cfa5f799a79b/ 2023-02-13 04:04:18,189 DEBUG [Listener at localhost/45365] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 04:04:18,189 DEBUG [Listener at localhost/45365] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 04:04:18,189 DEBUG [Listener at localhost/45365] util.CommonFSUtils(702): |----------------testWithMapReduce=f5be80b08306bbed37f5cfa5f799a79b-d70caed992b446e89f977c7ccc316029 2023-02-13 04:04:18,190 DEBUG [Listener at localhost/45365] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 04:04:18,190 DEBUG [Listener at localhost/45365] util.CommonFSUtils(702): |----------------testWithMapReduce=f5be80b08306bbed37f5cfa5f799a79b-76ff7afe1f3f4f339748b3cd356e6507 2023-02-13 04:04:18,190 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,191 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,191 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,192 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,192 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,192 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,193 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,258 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/hadoop-6741882777497644247.jar 2023-02-13 04:04:18,259 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,259 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,259 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,259 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,260 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,260 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,260 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 04:04:18,261 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 04:04:18,261 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 04:04:18,261 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 04:04:18,262 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 04:04:18,262 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 04:04:18,262 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 04:04:18,263 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 04:04:18,263 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 04:04:18,263 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 04:04:18,264 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 04:04:18,264 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 04:04:18,264 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 04:04:18,265 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 04:04:18,265 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 04:04:18,330 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/hadoop-6683371653744214835.jar 2023-02-13 04:04:18,331 DEBUG [Listener at localhost/45365] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 04:04:18,336 WARN [Listener at localhost/45365] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 04:04:18,369 INFO [Listener at localhost/45365] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 04:04:18,449 WARN [Listener at localhost/45365] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/mapreduce.cluster.local.dir/1676261058415/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 04:04:18,449 WARN [Listener at localhost/45365] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/mapreduce.cluster.local.dir/1676261058415/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 04:04:18,480 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 04:04:18,480 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 04:04:18,480 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 04:04:18,482 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:18,483 DEBUG [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/5cba1187-08f1-f0a4-2520-58dfdb5e1ea8/testWithMapReduceSingleRegion/13d84c85-132d-4d94-bd05-e7f43e8192fa/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1 2023-02-13 04:04:18,483 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5be80b08306bbed37f5cfa5f799a79b columnFamilyName f1 2023-02-13 04:04:18,487 DEBUG [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] regionserver.HStore(539): loaded hdfs://localhost:35733/user/jenkins/test-data/5cba1187-08f1-f0a4-2520-58dfdb5e1ea8/testWithMapReduceSingleRegion/13d84c85-132d-4d94-bd05-e7f43e8192fa/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/testWithMapReduce=f5be80b08306bbed37f5cfa5f799a79b-d70caed992b446e89f977c7ccc316029 2023-02-13 04:04:18,487 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] regionserver.HStore(310): Store=f5be80b08306bbed37f5cfa5f799a79b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:18,488 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:18,488 DEBUG [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35733/user/jenkins/test-data/5cba1187-08f1-f0a4-2520-58dfdb5e1ea8/testWithMapReduceSingleRegion/13d84c85-132d-4d94-bd05-e7f43e8192fa/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2 2023-02-13 04:04:18,488 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5be80b08306bbed37f5cfa5f799a79b columnFamilyName f2 2023-02-13 04:04:18,492 DEBUG [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] regionserver.HStore(539): loaded hdfs://localhost:35733/user/jenkins/test-data/5cba1187-08f1-f0a4-2520-58dfdb5e1ea8/testWithMapReduceSingleRegion/13d84c85-132d-4d94-bd05-e7f43e8192fa/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/testWithMapReduce=f5be80b08306bbed37f5cfa5f799a79b-76ff7afe1f3f4f339748b3cd356e6507 2023-02-13 04:04:18,492 INFO [StoreOpener-f5be80b08306bbed37f5cfa5f799a79b-1] regionserver.HStore(310): Store=f5be80b08306bbed37f5cfa5f799a79b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 04:04:18,492 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 04:04:18,493 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f5be80b08306bbed37f5cfa5f799a79b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72510199, jitterRate=0.08048616349697113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 04:04:18,493 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f5be80b08306bbed37f5cfa5f799a79b: Writing region info on filesystem at 1676261058480Initializing all the Stores at 1676261058481 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261058481Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676261058481Region opened successfully at 1676261058493 (+12 ms) 2023-02-13 04:04:18,761 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f5be80b08306bbed37f5cfa5f799a79b, disabling compactions & flushes 2023-02-13 04:04:18,761 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:18,761 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:18,761 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. after waiting 0 ms 2023-02-13 04:04:18,761 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:18,762 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:18,762 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f5be80b08306bbed37f5cfa5f799a79b: Waiting for close lock at 1676261058761Disabling compacts and flushes for region at 1676261058761Disabling writes for close at 1676261058761Writing region close event to WAL at 1676261058762 (+1 ms)Closed at 1676261058762 2023-02-13 04:04:19,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-13 04:04:19,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-13 04:04:19,486 INFO [Listener at localhost/45365] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 04:04:19,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 04:04:19,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-13 04:04:19,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:04:19,489 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261059489"}]},"ts":"1676261059489"} 2023-02-13 04:04:19,491 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-13 04:04:19,492 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-13 04:04:19,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f5be80b08306bbed37f5cfa5f799a79b, UNASSIGN}] 2023-02-13 04:04:19,493 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f5be80b08306bbed37f5cfa5f799a79b, UNASSIGN 2023-02-13 04:04:19,494 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f5be80b08306bbed37f5cfa5f799a79b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:19,494 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676261059494"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676261059494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676261059494"}]},"ts":"1676261059494"} 2023-02-13 04:04:19,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure f5be80b08306bbed37f5cfa5f799a79b, server=jenkins-hbase4.apache.org,34421,1676261055718}] 2023-02-13 04:04:19,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:04:19,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:19,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f5be80b08306bbed37f5cfa5f799a79b, disabling compactions & flushes 2023-02-13 04:04:19,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:19,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:19,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. after waiting 0 ms 2023-02-13 04:04:19,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:19,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 04:04:19,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b. 2023-02-13 04:04:19,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f5be80b08306bbed37f5cfa5f799a79b: Waiting for close lock at 1676261059647Running coprocessor pre-close hooks at 1676261059647Disabling compacts and flushes for region at 1676261059647Disabling writes for close at 1676261059647Writing region close event to WAL at 1676261059648 (+1 ms)Running coprocessor post-close hooks at 1676261059651 (+3 ms)Closed at 1676261059651 2023-02-13 04:04:19,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:19,653 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f5be80b08306bbed37f5cfa5f799a79b, regionState=CLOSED 2023-02-13 04:04:19,653 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676261059653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676261059653"}]},"ts":"1676261059653"} 2023-02-13 04:04:19,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 04:04:19,656 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure f5be80b08306bbed37f5cfa5f799a79b, server=jenkins-hbase4.apache.org,34421,1676261055718 in 159 msec 2023-02-13 04:04:19,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 04:04:19,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f5be80b08306bbed37f5cfa5f799a79b, UNASSIGN in 164 msec 2023-02-13 04:04:19,657 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676261059657"}]},"ts":"1676261059657"} 2023-02-13 04:04:19,658 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-13 04:04:19,660 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-13 04:04:19,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 174 msec 2023-02-13 04:04:19,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 04:04:19,791 INFO [Listener at localhost/45365] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-13 04:04:19,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-13 04:04:19,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:04:19,794 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:04:19,795 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:04:19,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 04:04:19,798 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:19,799 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1, FileablePath, hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2, FileablePath, hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/recovered.edits] 2023-02-13 04:04:19,802 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/a8198f1b047e47b6a6fe5f2ac9c13aea to hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/archive/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/a8198f1b047e47b6a6fe5f2ac9c13aea 2023-02-13 04:04:19,803 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/d70caed992b446e89f977c7ccc316029 to hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/archive/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f1/d70caed992b446e89f977c7ccc316029 2023-02-13 04:04:19,805 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/76ff7afe1f3f4f339748b3cd356e6507 to hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/archive/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/76ff7afe1f3f4f339748b3cd356e6507 2023-02-13 04:04:19,806 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/79ac494353a248c7a5716bdf1d8f2a5d to hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/archive/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/f2/79ac494353a248c7a5716bdf1d8f2a5d 2023-02-13 04:04:19,807 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/recovered.edits/12.seqid to hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/archive/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b/recovered.edits/12.seqid 2023-02-13 04:04:19,808 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/.tmp/data/default/testWithMapReduce/f5be80b08306bbed37f5cfa5f799a79b 2023-02-13 04:04:19,808 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 04:04:19,810 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:04:19,811 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-13 04:04:19,812 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-13 04:04:19,813 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:04:19,813 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-13 04:04:19,813 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676261059813"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:19,814 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 04:04:19,814 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f5be80b08306bbed37f5cfa5f799a79b, NAME => 'testWithMapReduce,,1676261056747.f5be80b08306bbed37f5cfa5f799a79b.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 04:04:19,814 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-13 04:04:19,815 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676261059814"}]},"ts":"9223372036854775807"} 2023-02-13 04:04:19,816 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-13 04:04:19,817 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 04:04:19,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 25 msec 2023-02-13 04:04:19,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40315] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 04:04:19,897 INFO [Listener at localhost/45365] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-13 04:04:19,897 INFO [Listener at localhost/45365] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 04:04:19,897 INFO [Listener at localhost/45365] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 04:04:19,897 DEBUG [Listener at localhost/45365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64f24106 to 127.0.0.1:60881 2023-02-13 04:04:19,897 DEBUG [Listener at localhost/45365] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:19,897 DEBUG [Listener at localhost/45365] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 04:04:19,897 DEBUG [Listener at localhost/45365] util.JVMClusterUtil(257): Found active master hash=1405262816, stopped=false 2023-02-13 04:04:19,897 INFO [Listener at localhost/45365] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40315,1676261055640 2023-02-13 04:04:19,900 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:19,900 INFO [Listener at localhost/45365] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 04:04:19,900 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:19,900 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:19,900 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 04:04:19,902 DEBUG [Listener at localhost/45365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x618e01fe to 127.0.0.1:60881 2023-02-13 04:04:19,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:19,902 DEBUG [Listener at localhost/45365] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:19,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:19,902 INFO [Listener at localhost/45365] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32969,1676261055690' ***** 2023-02-13 04:04:19,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 04:04:19,902 INFO [Listener at localhost/45365] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:04:19,903 INFO [Listener at localhost/45365] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34421,1676261055718' ***** 2023-02-13 04:04:19,903 INFO [Listener at localhost/45365] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 04:04:19,903 INFO [RS:0;jenkins-hbase4:32969] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:04:19,903 INFO [RS:1;jenkins-hbase4:34421] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 04:04:19,903 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:04:19,903 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 04:04:19,903 INFO [RS:0;jenkins-hbase4:32969] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:04:19,903 INFO [RS:1;jenkins-hbase4:34421] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 04:04:19,905 INFO [RS:0;jenkins-hbase4:32969] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:04:19,905 INFO [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(3304): Received CLOSE for 1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:19,905 INFO [RS:1;jenkins-hbase4:34421] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 04:04:19,905 INFO [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:19,905 INFO [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:19,905 DEBUG [RS:0;jenkins-hbase4:32969] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76ffe3cb to 127.0.0.1:60881 2023-02-13 04:04:19,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1980962eeaae32cc8f087063b7e12dad, disabling compactions & flushes 2023-02-13 04:04:19,905 DEBUG [RS:0;jenkins-hbase4:32969] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:19,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:19,905 INFO [RS:0;jenkins-hbase4:32969] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:04:19,905 INFO [RS:0;jenkins-hbase4:32969] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:04:19,905 INFO [RS:0;jenkins-hbase4:32969] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:04:19,905 DEBUG [RS:1;jenkins-hbase4:34421] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b93c1cf to 127.0.0.1:60881 2023-02-13 04:04:19,905 INFO [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 04:04:19,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:19,906 DEBUG [RS:1;jenkins-hbase4:34421] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:19,906 INFO [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 04:04:19,906 INFO [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34421,1676261055718; all regions closed. 2023-02-13 04:04:19,906 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 04:04:19,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. after waiting 0 ms 2023-02-13 04:04:19,906 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 04:04:19,906 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 04:04:19,906 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 04:04:19,906 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 04:04:19,906 DEBUG [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1479): Online Regions={1980962eeaae32cc8f087063b7e12dad=hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad., 1588230740=hbase:meta,,1.1588230740} 2023-02-13 04:04:19,906 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-13 04:04:19,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:19,906 DEBUG [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1505): Waiting on 1588230740, 1980962eeaae32cc8f087063b7e12dad 2023-02-13 04:04:19,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1980962eeaae32cc8f087063b7e12dad 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 04:04:19,909 DEBUG [RS:1;jenkins-hbase4:34421] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/oldWALs 2023-02-13 04:04:19,910 INFO [RS:1;jenkins-hbase4:34421] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34421%2C1676261055718:(num 1676261057021) 2023-02-13 04:04:19,910 DEBUG [RS:1;jenkins-hbase4:34421] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:19,910 INFO [RS:1;jenkins-hbase4:34421] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:19,910 INFO [RS:1;jenkins-hbase4:34421] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 04:04:19,910 INFO [RS:1;jenkins-hbase4:34421] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 04:04:19,910 INFO [RS:1;jenkins-hbase4:34421] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 04:04:19,910 INFO [RS:1;jenkins-hbase4:34421] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 04:04:19,910 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:19,911 INFO [RS:1;jenkins-hbase4:34421] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34421 2023-02-13 04:04:19,913 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:19,913 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:19,913 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:19,913 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34421,1676261055718 2023-02-13 04:04:19,914 ERROR [Listener at localhost/45365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b724865 rejected from java.util.concurrent.ThreadPoolExecutor@4f4dc5d3[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:19,914 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:19,914 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34421,1676261055718] 2023-02-13 04:04:19,914 ERROR [Listener at localhost/45365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62e73502 rejected from java.util.concurrent.ThreadPoolExecutor@4f4dc5d3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:19,914 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34421,1676261055718; numProcessing=1 2023-02-13 04:04:19,915 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34421,1676261055718 already deleted, retry=false 2023-02-13 04:04:19,915 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34421,1676261055718 expired; onlineServers=1 2023-02-13 04:04:19,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad/.tmp/info/d795361b2ca446ffa9b04601c85d620f 2023-02-13 04:04:19,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/.tmp/info/cdc841885bb340f987030b0164c331a0 2023-02-13 04:04:19,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad/.tmp/info/d795361b2ca446ffa9b04601c85d620f as hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad/info/d795361b2ca446ffa9b04601c85d620f 2023-02-13 04:04:19,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cdc841885bb340f987030b0164c331a0 2023-02-13 04:04:19,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad/info/d795361b2ca446ffa9b04601c85d620f, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 04:04:19,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1980962eeaae32cc8f087063b7e12dad in 28ms, sequenceid=6, compaction requested=false 2023-02-13 04:04:19,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/namespace/1980962eeaae32cc8f087063b7e12dad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 04:04:19,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:19,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1980962eeaae32cc8f087063b7e12dad: Waiting for close lock at 1676261059905Running coprocessor pre-close hooks at 1676261059905Disabling compacts and flushes for region at 1676261059905Disabling writes for close at 1676261059906 (+1 ms)Obtaining lock to block concurrent updates at 1676261059906Preparing flush snapshotting stores in 1980962eeaae32cc8f087063b7e12dad at 1676261059906Finished memstore snapshotting hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676261059906Flushing stores of hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. at 1676261059907 (+1 ms)Flushing 1980962eeaae32cc8f087063b7e12dad/info: creating writer at 1676261059907Flushing 1980962eeaae32cc8f087063b7e12dad/info: appending metadata at 1676261059910 (+3 ms)Flushing 1980962eeaae32cc8f087063b7e12dad/info: closing flushed file at 1676261059910Flushing 1980962eeaae32cc8f087063b7e12dad/info: reopening flushed file at 1676261059930 (+20 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 1980962eeaae32cc8f087063b7e12dad in 28ms, sequenceid=6, compaction requested=false at 1676261059934 (+4 ms)Writing region close event to WAL at 1676261059934Running coprocessor post-close hooks at 1676261059937 (+3 ms)Closed at 1676261059937 2023-02-13 04:04:19,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676261056248.1980962eeaae32cc8f087063b7e12dad. 2023-02-13 04:04:19,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/.tmp/rep_barrier/07a64fc805514c41b7816f1009860f6c 2023-02-13 04:04:19,941 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07a64fc805514c41b7816f1009860f6c 2023-02-13 04:04:19,948 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:19,948 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:19,954 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/.tmp/table/2656b47aedd14b2d9eb7daf060d30212 2023-02-13 04:04:19,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2656b47aedd14b2d9eb7daf060d30212 2023-02-13 04:04:19,957 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/.tmp/info/cdc841885bb340f987030b0164c331a0 as hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/info/cdc841885bb340f987030b0164c331a0 2023-02-13 04:04:19,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cdc841885bb340f987030b0164c331a0 2023-02-13 04:04:19,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/info/cdc841885bb340f987030b0164c331a0, entries=12, sequenceid=21, filesize=6.2 K 2023-02-13 04:04:19,961 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/.tmp/rep_barrier/07a64fc805514c41b7816f1009860f6c as hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/rep_barrier/07a64fc805514c41b7816f1009860f6c 2023-02-13 04:04:19,965 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07a64fc805514c41b7816f1009860f6c 2023-02-13 04:04:19,965 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/rep_barrier/07a64fc805514c41b7816f1009860f6c, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 04:04:19,965 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/.tmp/table/2656b47aedd14b2d9eb7daf060d30212 as hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/table/2656b47aedd14b2d9eb7daf060d30212 2023-02-13 04:04:19,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2656b47aedd14b2d9eb7daf060d30212 2023-02-13 04:04:19,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/table/2656b47aedd14b2d9eb7daf060d30212, entries=4, sequenceid=21, filesize=5.0 K 2023-02-13 04:04:19,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 63ms, sequenceid=21, compaction requested=false 2023-02-13 04:04:19,972 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 04:04:19,972 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 04:04:19,972 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:19,972 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676261059906Running coprocessor pre-close hooks at 1676261059906Disabling compacts and flushes for region at 1676261059906Disabling writes for close at 1676261059906Obtaining lock to block concurrent updates at 1676261059906Preparing flush snapshotting stores in 1588230740 at 1676261059906Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676261059906Flushing stores of hbase:meta,,1.1588230740 at 1676261059908 (+2 ms)Flushing 1588230740/info: creating writer at 1676261059908Flushing 1588230740/info: appending metadata at 1676261059914 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676261059914Flushing 1588230740/rep_barrier: creating writer at 1676261059930 (+16 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676261059932 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676261059932Flushing 1588230740/table: creating writer at 1676261059942 (+10 ms)Flushing 1588230740/table: appending metadata at 1676261059943 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676261059943Flushing 1588230740/info: reopening flushed file at 1676261059958 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676261059962 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676261059966 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 63ms, sequenceid=21, compaction requested=false at 1676261059969 (+3 ms)Writing region close event to WAL at 1676261059970 (+1 ms)Running coprocessor post-close hooks at 1676261059972 (+2 ms)Closed at 1676261059972 2023-02-13 04:04:19,972 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 04:04:19,988 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 04:04:19,988 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 04:04:20,100 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:20,100 INFO [RS:1;jenkins-hbase4:34421] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34421,1676261055718; zookeeper connection closed. 2023-02-13 04:04:20,100 ERROR [Listener at localhost/45365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a4d41b4 rejected from java.util.concurrent.ThreadPoolExecutor@4f4dc5d3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:20,100 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:34421-0x1004bd9c64c0002, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:20,100 ERROR [Listener at localhost/45365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3174ca7a rejected from java.util.concurrent.ThreadPoolExecutor@4f4dc5d3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:20,100 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@44f835fb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@44f835fb 2023-02-13 04:04:20,106 INFO [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32969,1676261055690; all regions closed. 2023-02-13 04:04:20,110 DEBUG [RS:0;jenkins-hbase4:32969] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/oldWALs 2023-02-13 04:04:20,110 INFO [RS:0;jenkins-hbase4:32969] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32969%2C1676261055690.meta:.meta(num 1676261056199) 2023-02-13 04:04:20,114 DEBUG [RS:0;jenkins-hbase4:32969] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/oldWALs 2023-02-13 04:04:20,114 INFO [RS:0;jenkins-hbase4:32969] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32969%2C1676261055690:(num 1676261056590) 2023-02-13 04:04:20,114 DEBUG [RS:0;jenkins-hbase4:32969] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:20,114 INFO [RS:0;jenkins-hbase4:32969] regionserver.LeaseManager(133): Closed leases 2023-02-13 04:04:20,114 INFO [RS:0;jenkins-hbase4:32969] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 04:04:20,114 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:20,117 INFO [RS:0;jenkins-hbase4:32969] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32969 2023-02-13 04:04:20,119 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32969,1676261055690 2023-02-13 04:04:20,119 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 04:04:20,119 ERROR [Listener at localhost/45365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5095ded4 rejected from java.util.concurrent.ThreadPoolExecutor@54aa401e[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:20,120 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32969,1676261055690] 2023-02-13 04:04:20,120 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32969,1676261055690; numProcessing=2 2023-02-13 04:04:20,121 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32969,1676261055690 already deleted, retry=false 2023-02-13 04:04:20,121 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32969,1676261055690 expired; onlineServers=0 2023-02-13 04:04:20,121 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40315,1676261055640' ***** 2023-02-13 04:04:20,121 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 04:04:20,122 DEBUG [M:0;jenkins-hbase4:40315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57fd1540, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 04:04:20,122 INFO [M:0;jenkins-hbase4:40315] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40315,1676261055640 2023-02-13 04:04:20,122 INFO [M:0;jenkins-hbase4:40315] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40315,1676261055640; all regions closed. 2023-02-13 04:04:20,122 DEBUG [M:0;jenkins-hbase4:40315] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 04:04:20,122 DEBUG [M:0;jenkins-hbase4:40315] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 04:04:20,122 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 04:04:20,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261055851] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676261055851,5,FailOnTimeoutGroup] 2023-02-13 04:04:20,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261055851] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676261055851,5,FailOnTimeoutGroup] 2023-02-13 04:04:20,122 DEBUG [M:0;jenkins-hbase4:40315] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 04:04:20,123 INFO [M:0;jenkins-hbase4:40315] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 04:04:20,123 INFO [M:0;jenkins-hbase4:40315] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 04:04:20,124 INFO [M:0;jenkins-hbase4:40315] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 04:04:20,124 DEBUG [M:0;jenkins-hbase4:40315] master.HMaster(1502): Stopping service threads 2023-02-13 04:04:20,124 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 04:04:20,124 INFO [M:0;jenkins-hbase4:40315] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 04:04:20,124 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 04:04:20,124 ERROR [M:0;jenkins-hbase4:40315] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 04:04:20,124 INFO [M:0;jenkins-hbase4:40315] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 04:04:20,124 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 04:04:20,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 04:04:20,125 DEBUG [M:0;jenkins-hbase4:40315] zookeeper.ZKUtil(398): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 04:04:20,125 WARN [M:0;jenkins-hbase4:40315] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 04:04:20,125 INFO [M:0;jenkins-hbase4:40315] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 04:04:20,125 INFO [M:0;jenkins-hbase4:40315] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 04:04:20,125 DEBUG [M:0;jenkins-hbase4:40315] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 04:04:20,126 INFO [M:0;jenkins-hbase4:40315] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:20,126 DEBUG [M:0;jenkins-hbase4:40315] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:20,126 DEBUG [M:0;jenkins-hbase4:40315] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 04:04:20,126 DEBUG [M:0;jenkins-hbase4:40315] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:20,126 INFO [M:0;jenkins-hbase4:40315] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.67 KB heapSize=65.63 KB 2023-02-13 04:04:20,137 INFO [M:0;jenkins-hbase4:40315] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7108eab5f20f4ab4a5a0bb4d5ee53c4a 2023-02-13 04:04:20,141 DEBUG [M:0;jenkins-hbase4:40315] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7108eab5f20f4ab4a5a0bb4d5ee53c4a as hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7108eab5f20f4ab4a5a0bb4d5ee53c4a 2023-02-13 04:04:20,145 INFO [M:0;jenkins-hbase4:40315] regionserver.HStore(1080): Added hdfs://localhost:35733/user/jenkins/test-data/31e3838d-6616-5387-38fd-ecea858ad834/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7108eab5f20f4ab4a5a0bb4d5ee53c4a, entries=17, sequenceid=132, filesize=8.6 K 2023-02-13 04:04:20,146 INFO [M:0;jenkins-hbase4:40315] regionserver.HRegion(2947): Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false 2023-02-13 04:04:20,146 INFO [M:0;jenkins-hbase4:40315] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 04:04:20,147 DEBUG [M:0;jenkins-hbase4:40315] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676261060125Disabling compacts and flushes for region at 1676261060125Disabling writes for close at 1676261060126 (+1 ms)Obtaining lock to block concurrent updates at 1676261060126Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676261060126Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55987, getHeapSize=67184, getOffHeapSize=0, getCellsCount=145 at 1676261060126Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676261060127 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676261060127Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676261060128 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676261060128Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676261060142 (+14 ms)Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=132, compaction requested=false at 1676261060146 (+4 ms)Writing region close event to WAL at 1676261060146Closed at 1676261060146 2023-02-13 04:04:20,149 INFO [M:0;jenkins-hbase4:40315] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 04:04:20,149 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 04:04:20,149 INFO [M:0;jenkins-hbase4:40315] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40315 2023-02-13 04:04:20,152 DEBUG [M:0;jenkins-hbase4:40315] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40315,1676261055640 already deleted, retry=false 2023-02-13 04:04:20,501 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:20,501 INFO [M:0;jenkins-hbase4:40315] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40315,1676261055640; zookeeper connection closed. 2023-02-13 04:04:20,501 ERROR [Listener at localhost/45365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b4fdb1f rejected from java.util.concurrent.ThreadPoolExecutor@3f7058ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:20,502 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): master:40315-0x1004bd9c64c0000, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:20,502 ERROR [Listener at localhost/45365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e900b77 rejected from java.util.concurrent.ThreadPoolExecutor@3f7058ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:20,601 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:20,601 INFO [RS:0;jenkins-hbase4:32969] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32969,1676261055690; zookeeper connection closed. 2023-02-13 04:04:20,601 ERROR [Listener at localhost/45365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e6e94ef rejected from java.util.concurrent.ThreadPoolExecutor@54aa401e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:20,602 DEBUG [Listener at localhost/45365-EventThread] zookeeper.ZKWatcher(600): regionserver:32969-0x1004bd9c64c0001, quorum=127.0.0.1:60881, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 04:04:20,602 ERROR [Listener at localhost/45365-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@265f9c28 rejected from java.util.concurrent.ThreadPoolExecutor@54aa401e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 04:04:20,602 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f9852ea] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f9852ea 2023-02-13 04:04:20,602 INFO [Listener at localhost/45365] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 04:04:20,602 WARN [Listener at localhost/45365] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:04:20,605 INFO [Listener at localhost/45365] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:20,711 WARN [BP-1807544398-172.31.14.131-1676261054942 heartbeating to localhost/127.0.0.1:35733] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:04:20,711 WARN [BP-1807544398-172.31.14.131-1676261054942 heartbeating to localhost/127.0.0.1:35733] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1807544398-172.31.14.131-1676261054942 (Datanode Uuid 2a91f016-0e02-4549-971f-ab0bc97642f5) service to localhost/127.0.0.1:35733 2023-02-13 04:04:20,712 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/cluster_0e771705-44ed-8660-8455-552746cd4e73/dfs/data/data3/current/BP-1807544398-172.31.14.131-1676261054942] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:20,712 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/cluster_0e771705-44ed-8660-8455-552746cd4e73/dfs/data/data4/current/BP-1807544398-172.31.14.131-1676261054942] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:20,713 WARN [Listener at localhost/45365] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 04:04:20,715 INFO [Listener at localhost/45365] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:20,717 WARN [BP-1807544398-172.31.14.131-1676261054942 heartbeating to localhost/127.0.0.1:35733] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 04:04:20,717 WARN [BP-1807544398-172.31.14.131-1676261054942 heartbeating to localhost/127.0.0.1:35733] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1807544398-172.31.14.131-1676261054942 (Datanode Uuid f85500f4-ee6d-44b2-aa56-ef1af6667306) service to localhost/127.0.0.1:35733 2023-02-13 04:04:20,717 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/cluster_0e771705-44ed-8660-8455-552746cd4e73/dfs/data/data1/current/BP-1807544398-172.31.14.131-1676261054942] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:20,718 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c647c91b-895a-9195-58ed-b69f6262dec2/cluster_0e771705-44ed-8660-8455-552746cd4e73/dfs/data/data2/current/BP-1807544398-172.31.14.131-1676261054942] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 04:04:20,726 INFO [Listener at localhost/45365] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 04:04:20,839 INFO [Listener at localhost/45365] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 04:04:20,866 INFO [Listener at localhost/45365] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 04:04:20,878 INFO [Listener at localhost/45365] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 273) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45365 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:35733 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35733 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:35733 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:35733 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40315,1676261055640)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:35733 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:35733 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1462172089) connection to localhost/127.0.0.1:35733 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=601 (was 583) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=268 (was 282), ProcessCount=168 (was 168), AvailableMemoryMB=3561 (was 3808)